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PREFACE 


This book is intended to serve as a text for the course in analysis that is usually 
taken by advanced undergraduates or by first-year students who study mathe- 
matics. 

The present edition covers essentially the same topics as the second one, 
with some additions, a few minor omissions, and considerable rearrangement. I 
hope that these changes will make the material more accessible amd more attrac- 
tive to the students who take such a course. 

Experience has convinced me that it is pedagogically unsound (though 
logically correct) to start off with the construction of the real numbers from the 
rational ones. At the beginning, most students simply fail to appreciate the need 
for doing this. Accordingly, the real number system is introduced as an ordered 
field with the least-upper-bound property, and a few interesting applications of 
this property are quickly made. However, Dedekind’s construction is not omit- 
ted. It is now in an Appendix to Chapter |, where it may be studied and enjoyed 
whenever the time seems ripe. 

The material on functions of several variables is almost completely re- 
written, with many details filled in, and with more examples and more motiva- 
tion. The proof of the inverse function theorem--the key item in Chapter 9—1s 


X PREFACE 


simplified by means of the fixed point theorem about contraction mappings. 
Differential forms are discussed in much greater detail. Several applications of 
Stokes’ theorem are included. 

As regards other changes, the chapter on the Riemann-Stieltjes integral 
has been trimmed a bit, a short do-it-yourself section on the gamma function 
has been added to Chapter 8, and there is a large number of new exercises, most 
of them with fairly detailed hints. 

I have also included several references to articles appearing in the American 
Mathematical Monthly and in Mathematics Magazine, in the hope that students 
will develop the habit of looking into the journal literature. Most of these 
references were kindly supplied by R. B. Burckel. 

Over the years, many people, students as well as teachers, have sent me 
corrections, criticisms, and other comments concerning the previous editions 
of this book. I have appreciated these, and I take this opportunity to express 
my sincere thanks to all who have written me. 


WALTER RUDIN 


I 


THE REAL AND COMPLEX NUMBER SYSTEMS 


INTRODUCTION 


A satisfactory discussion of the main concepts of analysis (such as convergence, 
continuity, differentiation, and integration) must be based on an accurately 
defined number concept. We shall not, however, enter into any discussion of 
the axioms that govern the arithmetic of the integers, but assume familiarity 
with the rational numbers (i.e., the numbers of the form m/n, where m and n 
are integers and n ¥ 0). 

The rational number system is inadequate for many purposes, both as a 
field and as an ordered set. (These terms will be defined in Secs. 1.6 and 1.12.) 
For instance, there is no rational p such that p? = 2. (We shall prove this 
presently.) This leads to the introduction of so-called “‘irrational numbers” 
which are often written as infinite decimal expansions and are considered to be 
‘“‘approximated”’ by the corresponding finite decimals. Thus the sequence 


1, 1.4, 1.41, 1.414, 1.4142,... 


“tends to “a But unless the irrational number ,/2 has been clearly defined, 
the question must arise: Just what is it that this sequence “‘tends to”? 
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This sort of question can be answered as soon as the so-called ‘‘real 
number system’”’ is constructed. 


1.1 Example We now show that the equation 
(1) p> =2 


is not satisfied by any rational p. If there were such a p, we could write p = m/n 
where m and n are integers that are not both even. Let us assume this is done. 
Then (1) implies 


(2) m? = 2n’, 


This shows that m? is even. Hence m is even (if m were odd, mm? would be odd), 
and so m* is divisible by 4. It follows that the right side of (2) is divisible by 4. 
so that 1? is even. which implies that n is even. 

The assumption that (1) holds thus leads to the conclusion that both m 
and n are even, contrary to our choice of m and n. Hence (1) is impossible for 
rational p. 

We now examine this situation a little more closely. Let A be the set of 
all positive rationals p such that p? < 2 and let B consist of all positive rationals 
psuch that p? > 2. We shall show that A contains no largest number and B con- 
tains no smallest. 

More explicitly, for every p in A we can find a rational qg in A such that 
p <q, and for every p in B we can find a rational q in B such that q < p. 

To do this, we associate with each rational p > 0 the number 


(3) ee ome Be | 
jo& f p+2 p+2 
Then 
| 2(p? — 2) 
4 ai = 
y r (p + 2)’ 


If p is in A then p*? —2 <0, (3) shows that q > p. and (4) shows that 
q? <2. Thus q is in A. 

If p is in B then p? — 2 > 0, (3) shows that 0 <q <p, and (4) shows that 
q? >2. Thus q is in B. 


1.2 Remark Thc purpose of the above discussion has been to show that the 
rational number system has certain gaps, in spite of the fact that between any 
two rationals there is another: If r <s then r < (r + 5)/2 <s. The real number 
system fills these gaps. This is the principal reason for the fundamental role 
which it plays in analysis. 
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In order to elucidate its structure, as well as that of the complex numbers, 
we start with a brief discussion of the general concepts of ordered set and field. 

Here is some of the standard set-theoretic terminology that will be used 
throughout this book. 


1.3 Definitions If A is any set (whose elements may be numbers or any other 
objects), we write x € A to indicate that + is a member (or an element) of A. 

If x is not a member of A, we write: x ¢ A. 

The set which contains no element will be called the empty ser. Ifa set has 
at least one element, it is called nonempty. 

If A and B are sets, and if every element of A is an element of B, we say 
that A is a subset of B, and write A c B, or B=> A. If, in addition, there is an 
element of B which is not in A, then A ts said to be a proper subset of B. Note 
that A c A for every set A. 

If Ac Band Bc A, we write A = B. Otherwise A # B. 


1.4 Definition Throughout Chap. 1, the set of all rational numbers will be 
denoted by Q. 


ORDERED SETS 


1.5 Definition Let S be a set. Anorder on S is a relation, denoted by <, with 
the following two properties: 


(i) If xe S and ye S then one and only one of the statements 


eye x = yx 
is true. 


am We a zeS. @e =< puma t < \. tien y=” 


The statement ‘‘x < y’’ may be read as ‘‘x is less than y”’ or “‘x is smaller 
thie ‘Wor “*.. precedes’. 

It is often convenient to write y > x in place of x < y. 

The notation x < } indicates that x < ) or x = y, without specifying which 
of these two is to hold. In other words, x < y is the negation of x > y. 


1.6 Definition An ordered set is a set S in which an order ts defined. 
For example, Q is an ordered set if r < 5 is defined to mean that s— risa 
positive rational number. 


1.7. Definition Suppose S is an ordered set, and ES. If there exists a 
Be S such that x < B for every x € E, we say that E ts bounded above, and call 
B an upper bound of E. : 

Lower bounds are defined in the same way (with > in place of s). 
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1.8 Definition Suppose S is an ordered set, Ec S, and E is bounded above. 
Suppose there exists an « € S with the following properties: 


(i) ais an upper bound of E. 
(ii) If y <a then y is not an upper bound of E. 


Then « is called the /east upper bound of E [that there is at most one such 
a is clear from (ii)] or the supremum of E, and we write 


= sup E. 


The greatest lower bound, or infimum, of a set E which is bounded below 
is defined in the same manner: The statement 


a=infE 


means that « is a lower bound of E and that no B with B > « is a lower bound 
of E. 


1.9 Examples 


(a) Consider the sets A and B of Example 1.1 as subsets of the ordered 
set Q. The set A is bounded above. In fact, the upper bounds of A are 
exactly the members of B. Since B contains no smallest member, A has 
no least upper bound in Q. 

Similarly, B is bounded below: The set of all lower bounds of B 
consists of A and of all re Q with r <0. Since A has no lasgest member, 
B has no greatest lower bound in Q. 

(6) If «=sup E exists, then a may or may not be a member of E. For 
instance, let E, be the set of all re Q with r <0. Let E, be the set of all 
reQ withr<0. Then 


sup FE, = sup E, = 0, 


and 0¢£,,0¢eE,. 
(c) Let E consist of all numbers 1/n, where n= 1, 2, 3,.... Then 
sup E = 1, which is in E, and inf E = 0, which is not in E. 


1.10 Definition An ordered set S is said to have the least-upper-bound property 
if the following is true: 
If Ec S, Eis not empty, and E is bounded above, then sup E exists in S. 
Example !.9(a) shows that Q does not have the least-upper-bound property. 
We shall now show that there is a close relation between greatest lower 
bounds and least upper bounds, and that every ordered set with the least-upper- 
bound property also has the greatest-lower-bound property. 
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1.11 Theorem Suppose S is an ordered set with the least-upper-bound property, 
Bc S, B is not empty, and B is bounded below. Let L be the set of all lower 
bounds of B. Then 


a=supL 


exists in S, and « = inf B. 


In particular, inf B exists in S. 


Proof Since B is bounded below, L is not empty. Since L consists of 
exactly those ye S which satisfy the inequality y < x for every x € B, we 
see that every x € B is an upper bound of L. Thus L is bounded above. 
Our hypothesis about S implies therefore that L has a supremum in S; 
call it a. 

If y <a then (see Detinition 1.8) y is not an upper bound of L, 
hence y ¢ B. It follows that « < x for every xe B. Thus ae L. 

If a < B then B ¢ L, since a is an upper bound of L. 

We have shown that ae Ll but B¢Lif fp >a. In other words, « 
is a lower bound of B, but f is not if 8 > a. This means that « = inf B. 


FIELDS 


1.12 Definition A field is a set F with two operations, called addition and 
multiplication, which satisfy the following so-called ‘‘field axioms’’ (A), (M), 
and (D): 


(A) Axioms for addition 


(M) 


(Al) If xe Fand ye F, then their sum x + y is in F. 

(A2) Addition is commutative: x + y = y + x for all x, ye F. 

(A3) Addition is associative: (x + y) + z= x + (y + z) for all x, y, z€ F. 
(A4) F contains an element 0 such that 0 + x = x for every xe F. 

(A5) To every xeF corresponds an element —xeF such that 


x+(—x) =0. 


Axioms for multiplication 


(M1) If xeF and ye F, then their product xy is in F. 

(M2) Multiplication is commutative: xy = yx for all x, ye F. 

(M3) Multiplication is associative: (xy)z = x(yz) for all x, », ze F. 
(M4) F contains an element | 4 0 such that Ix = x for every xe F. 
(M5) If xe F and x £0 then there exists an element 1/x € F such that 


x: (1/x) = 1. 
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(D) The distributive law 


x(y + Z) = xy + xz 


holds for all x, y, zé F. 


1.13 


1.14 


Remarks 


(a) One usually writes (in any field) 
x Wage ee ee ee ae ew 
in place of 
x+(-y.-(). ot +2 (xp apter, HNK, en IF SEK, oes 


(b) The field axioms clearly hold in Q, the set of all rational numbers, if 
addition and multiplication have their customary meaning. Thus Q is a 
field. 

(c) Although it is not our purpose to study fields (or any other algebraic 
structures) in detail, it is worthwhile to prove that some familiar properties 
of Q are consequences of the field axioms; once we do this, we will not 
need to do it again for the real numbers and for the complex numbers. 


Proposition The axioms for addition imply the following statements. 


(a) Ifx+y=x+2Z then y =z. 
(6) Ifx+y=x then y =0. 
(c) Ifx+y=0 then y= —x. 
(© is Gaia. 


Statement (a) is a cancellation law. Note that (+) asserts the uniqueness 


of the element whose existence is assumed in (A4), and that (c) does the same 
for (AS). 


Proof If x + y= x +z, the axioms (A) give 


y =O + p= (—4 +) +.yre—vei(Coehip) 
=—x4+(x4+z)=(-—x4x)4+2=0+4+2=2z. 


This proves (a). Take z = 0 in (a) to obtain (b). Take z = —x in (a) to 
obtain (c). 
Since —x + x = 0, (c) (with — x in place of x) gives (d). 


1.55 


1.16 


zeF. 
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Proposition The axioms for multiplication imply the following statements. 
ay if x # Cand xy = xz Hen y= Zz. 

(oe) 1x7 O0'and xy =x then y=1,. 

© xf O0andxy= 1 ty =1/x 

@) Ifx#0 then 1/O/)= x, 


The proof is so similar to that of Proposition 1.14 that we omit it. 


Proposition The field axioms imply the following statements, for any x, y, 


(a) Ox =0. 
(b) Ifx #0 and y £0 then xy £0. 
(c) (—x)y = —(@y) = x(-y). 
(dZ) (—xX—y) = xy. 
Proof 0x + 0x =(0 + 0)x = 0x. Hence 1.14(b) implies that 0x = 0, and 
(a) holds. 
Next, assume x # 0, y 40, but xy = 0. Then (a) gives 


Piu/l 1\ /1 
(Ro le-e 
yl \x yl] Nx 
a contradiction. Thus (5) holds. 
The first equality in (c) comes from 
(—x)y # xy = (-x + x)y = Oy =0, 


combined with 1.14(c); the other half of (c) is proved in the same way. 
Finally, 

(a) = - A -W— — (=r 
by (c) and 1.14(d). 


1.17 Definition An ordered field is a field F which is also an ordered set, such 


that 


(i) x+y<x+4+zifx,y,zeFandy <z, 
(ii) xy >Oifxe F,yeF,x>0,andy>0. 


If x > 0, we call x positive; if x <0, x is negative. 


For example, @ is an ordered field. 
All the familiar rules for working with inequalities apply in every ordered 


field: Multiplication by positive [negative] quantities preserves [reverses] In- 
equalities, no square is negative, etc. The following proposition lists some of 
these. 
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1.18 Proposition The following statements are true in every ordered field. 


(a) Ifx>0 then —x <0, and vice versa. 

(6) Ifx>Oand y <z then xy <xz. 

(c) Ifx<Oand y <z then xy> xz. 

(d) If x #0 then x? >0. In particular, 1 > 0. 
(e:) df0< x.cputhen 0. chp de 


Proof 

(a) Ifx>Othen0 = —x+x>-—x+0,sothat —x <0. If x <0 then 
O0= —-x+x< —x+0, so that —x >0. This proves (a). 

(6) Since z>y, we have z—y>y—y=0, hence x(z—y)>0, and 
therefore 


xz = X(z — y) + xp POP ye 1X): 
(c) By (a), (6), and Proposition 1.16(c), 
— [Az — y= (—x)e—y) > 0; 


so that x(z — y) < 0, hence xz < xy. 

(d) If x >0, part (ii) of Definition 1.17 gives x7 >0. If x <0, then 
—x>0, hence (—x)?>0. But x? =(—x)*, by Proposition 1.16(d). 
Since 1 = 17, 1 > 0. 

(e) Ify>Oandv <0, then yw< 0. But y« (li/y) = 10. Menee 1/y > 0. 
Likewise, 1/x > 0. If we multiply both sides of the inequality x <) by 
the positive quantity (1/x)(1/y), we obtain 1/y < 1/x. 


THE REAL FIELD 


We now state the existence theorem which is the core of this chapter. 


1.19 Theorem There exists an ordered field R which has the least-upper-bound 


property. 
Moreover, R contains Q as a subfield. 


The second statement means that Qc R and that the operations of 
addition and multiplication in R, when applied to members of Q, coincide with 
the usual operations on rational numbers; also, the positive rational numbers 
are positive elements of R. 

The members of R are called real numbers. 

The proof of Theorem 1.19 is rather long and a bit tedious and is therefore 
presented in an Appendix to Chap. 1. The proof actually constructs R from Q. 
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The next theorem could be extracted from this construction with very 
little extra effort. However, we prefer to derive it from Theorem 1.19 since this 
provides a good illustration of what one can do with the least-upper-bound 


property. 


1.20 Theorem 


(a) IfxeR, ye R, and x >0, then there is a positive integer n such that 
nx > y. 
(6) IfxeR,ye R,andx < y, then there existsap€ Qsuchthatx<p<y. 


Part (a) is usually referred to as the archimedean property of R. Part (b) 
may be stated by saying that Q is dense in R: Between any two real numbers 
there is a rational one. 


Proof 

(a) Let A be the set of all mx, where n runs through the positive in-cgers. 
If (a) were false, then y would be an upper bound of A. But then A has a 
least upper bound in R. Put x=supA. Since x >0, «-—x<a, and 
a — x is not an upper bound of A. Hence x — x < mx for some positive 
integer m. But then « < (m+ 1)x eA, which is impossible, since a is an 


upper bound of A. 
(b) Since x < y, we have y — x > 0, and (a) furnishes a positive integer 


n such that 
niy—x)>1. 


Apply (a) again, to obtain positive integers m, and m, such that m, > nx, 
m, > —nx. Then 


—m,<nx <m,. 
Hence there is an integer m (with —m, < _m < m,) such that 
m—1<nx<m. 
If we combine these inequalities, we obtain 
nx<m<1+nx <ny. 


Since n > 0, it follows that 


This proves (5), with p = m/n. 
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We shall now prove the existence of mth roots of positive reals. This 
proof will show how the difficulty pointed out in the Introduction (irration- 


ality of ./2) can be handled in R. 


1.21 Theorem For every real x >0 and every integer n>O there is one 
and only one real y such that y" = x. 


This number y is written 2/x or x!/". 


Proof That there is at most one such y is clear, since 0 < y, < y, implies 
Mi Si. 

Let E be the set consisting of all positive real numbers ¢ such that 
(i < we. 

if t= x/(1 + x) then 0 <t<.1. Hencest”<t< x. Thuswe £, and 
E is not empty. 

Iff>1+.x then **" >> x, so that t¢ E. Thus | + x is an upper 
bound of E. 

Hence Theorem 1.19 implies the existence of 

ypsup £. 

To prove that y” = x we will show that each of the inequalities »" < x 
and y" > x leads to a contradiction. 

The identity b" — a" =(b—a)(b""' + b"-2a +--+: + a"') yields 
the inequality 

b" — a" < (b — a)nb"™' 

when 0 <a<b. 

Assume y” < x. Choose / so that 0 <h <1 and 

< ~— es 
n(y + 1) 

Puta=y,b=y+h. Then 


(y + hy" — y" < hn(y + Ay! <hn(y + 1) <x 3". 


Thus (vy +h)" <x, and y+heE. Since y+h>y, this contradicts the 
fact that y is an upper bound of E. 
Assume )” > x. Put 


ee 
ny” 
ThenO<k<y. If t> y—k, we conclude that 
VY —-h ay => -— PP ata =e 
Thus t”> x, and ¢¢ £. It follows that » —k is an upper bound of E. 
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But )'— k < y, which contradicts the fact that y is the /east upper bound 
of E. 


Hence y” = x, and the proof is complete. 


Corollary [fa and b are positive real numbers and n is a positive integer, then 


(ab)! _ quinplin 
Proof Puta =a'"”,p=b'". Then 
ab pe a" _ (xpB)", 


since multiplication is commutative. [Axiom (M2) in Definition 1.12.] 


The uniqueness assertion of Theorem 1.21 shows therefore that 


(aby = a8 = *. 


1.22 Decimals We conclude this section by pointing out the relation between 
real numbers and decimals. 

Let x > 0 be real. Let 9 be the largest integer such that 7) < x. (Note that 
the existence of 79 depends on the archimedean property of R.) Having chosen 


Hos 22s n,—,, let n, be the largest integer such that 
—- — 
. — 
a ‘ao ™ 

Let E be the set of these numbers 

ny ny 
5 +—4f°:'°4+— ee 012... 6). 
(5) ta ae “- + a ( ) 


Then a = sup E. The decimal expansion of x is 
(6) Ng MNqhgNsy °° . 

Conversely, for any infinite decimal (6) the set © of numbers (5) is bounded 
above, and (6) is the decimal expansion of sup E. 


Since we shall never use decimals, we do not enter into a detailed 
discussion. 


THE EXTENDED REAL NUMBER SYSTEM 


1.23 Definition The extended real number system consists of the real field R 
and two symbols. + x and —c. We preserve the original order in R, and 
define 

a te 


for every ve R. 
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It is then clear that + oo is an upper bound of every subset of the extended 
real number system, and that every nonempty subset has a least upper bound. 
If, for example, E is a nonempty set of real numbers which is not bounded 
above in R, then sup E = +00 in the extended real number system. 

Exactly the same remarks apply to lower bounds. 


The extended real number system does not form a field, but it is customary 
to make the following conventions: 


(a) If x is real then 
x+0O= +0, x—-0O= —O, — = — =0. 


(6) Ifx>Othen x: (+0) = +0, x: (—o) = —oo. 
(c) If x <0 then x: (+00) = —o, x‘(—0)= +00. 


When it is desired to make the distinction between real numbers on the 
one hand and the symbols + oo and — oo on the other quite explicit, the former 
are called finite. 


THE COMPLEX FIELD 


1.24 Definition A complex number is an ordered pair (a, b) of real numbers. 
‘“‘Ordered’’ means that (a, b) and (6, a) are regarded as distinct if a # b. 

Let x = (a, b), y = (c, d) be two complex numbers. We write x = y if and 
only if a=c and b=d. (Note that this definition is not entirely superfluous; 
think of equality of rational numbers, represented as quotients of integers.) We 
define 

x+y=(a+c,b+d), 


xy = (ac — ba, ad + bc). 


1.25 Theorem These definitions of addition and multiplication turn the set of 
all complex numbers into a field, with (O, 0) and (1, 0) in the role of 0 and 1. 


Proof We simply verify the field axioms, as listed in Definition 1.12. 
(Of course, we use the field structure of R.) 


Let x = (a,b), y =(c;4), 2 
(Al) is clear. 
(A2) x+y=(a+c,b+d)=(c+a,d+b)=y+t+x. 
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(A3) (x+y)+z=(a+c,b4+d)+ (ef) 
=(a+c+e,b+d+f) 
—=@,.b) + (c Fe,dt+fy=xtQ Fz. 
(A4) x+0=(a, bd) + (0,0) =(a, b) =x. 
(A5) Put —x =(-—a, —6). Then x + (—x) = (0,0) = 
(M1) is clear. 
(M2) xy = (ac — bd, ad + bc) = (ca — db, da + cb) = 
(M3) (xy)z = (ac — bd, ad + bce, f) 
= (ace — bde — adf — bcf, acf — bdf + ade + bce) 
= (a, b)(ce — df, cf + de) = x(yz). 
(M4) 1x =(1, 0)(a, b) = (a, b) = x. 
(M5) If x 40 then (a, b) 4 (0, 0), which means that at least one of the 
real numbers a, b is different from 0. Hence a? + b? > 0, by Proposition 
1.18(d), and we can define 


l = a —b 
x lath? ath 
Then 


b 
= (a »( a +b?’ Re a+) > flimiO az: 1.. 


(D) x(y+z)=(a, b)c+e,d+f) 
= (ac + ae — bd — bf, ad + af + bc + be) 
= (ac — bd, ad + bc) + (ae — bf, af + be) 


= xy + xz. 


1.26 Theorem For any real numbers a and b we have 
(a, 0) + (6, 0) = (a+ 5, 0), (a, Ob, 0) = (ab, 0). 


The proof is trivial. 


Theorem 1.26 shows that the complex numbers of the form (a, 0) have the 
same arithmetic properties as the corresponding real numbers a. We can there- 
fore identify (a, 0) with a. This identification gives us the real field as a subfield 
of the complex field. 

The reader may have noticed that we have defined the complex numbers 
without any reference to the mysterious square root of —1. We now show that 
the notation (a, 6) is equivalent to the more customary a + bi. 


1.27 Definition / = (0, 1). 


14 PRINCIPLES OF MATHEMATICAL ANALYSIS 


1.28 Theorem i? = —1. , 
Braat i? = (0, 10.) ye 1) Se 


1.29 Theorem Jf a and b are real, then (a, b) =a + bi. 
Proof 
a + bi =(a, 0) + (4, 0)(0, 1) 
= (a, 0) + (0, b) = (a, D). 


1.30 Definition If a, b are real and z=a-+ bi, then the complex number 
Zz =a — bi is called the conjugate of z. The numbers a and b are the real part 
and the imaginary part of z, respectively. 

We shall occasionally write 


a= Re), b=im(z). 


1.31 Theorem I/fz and w are complex, then 


(a) z+w=Z+4+W, 

(ez 7 oat 

(c) 2+Z=2 Re(z), z-—Z=2iIm(2), 

(d) zz is real and positive (except when z = 0). 


Proof (a), (b), and (c) are quite trivial. To prove (d), write z =a + bi, 
and note that zZ = a? + b?. 


1.32 Definition If z is a complex number, its absolute value |z| is the non- 
negative square root of zz; that is, |z| = (zz)'/?. 

The existence (and uniqueness) of |zj follows from Theorem 1.21 and 
part (d) of Theorem 1.31. 

Note that when x is real, then x = x, hence |x| =,/x?. Thee tye =x 
if.x 2nO;, |x| =-- xpifeemeOh 


1.33. Theorem Let z and w be complex numbers. Then 


(a) |z| > Ov@ilessoz=70,,|0| =10; 


(6) |z| = {2|, 
(c) |zw| = |z||wI, 
(d) |Rez|<|z|, 


(e) |z+ wl s |z| + |v}. 
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Proof (a) and (b) are trivial. Put z = a+ bi, w=c + di, with a | 
real. Then 


|zw|? = (ac — bd)’ + (ad + bc)? = (a? + b*)(c? + d?) = |2|?|w|? 
or |zw|* =(|z||w|)?. Now (c) follows from the uniqueness assertion of 


Theorem 1.21. 
To prove (d), note that a? < a? + b?, hence 


jal =./a? < /a? +.6. 
To prove (e), note that Zw is the conjugate of zw, so that zw + Zw = 
2 Re (zw). Hence 


|z+w|? =(z 4+ w\(Z + W) = 27 + zw + Zw + Ww 
= |z|7 +2 Re (zw) + |w|? 
< |z|? +2|zw| + |w)? 
= |z|* + 2|z||w] + |wl? =({z| + ||)’. 


Now (e) follows by taking square roots. 


1.34 Notation If x,,..., x, are complex numbers, we write 
X, ex, eo +X, =) X,- 


We conclude this section with an important inequality, usually known as 
the Schwarz inequality. 


1.35 Theorem /fa,,..., a, and b,,..., 6, are complex numbers, then 


: s a;b; 
j=1 


Proof Put A = Z|a,;|’, B= 2|b,|’, C = La;,5, (in all sums in this proof, 
j runs over the values 1, ...,”). If B= 0, then b, = :-: = 6, = 0, and the 
conclusion is trivial. Assume therefore that B > 0. By Theorem 1.31 we 


have 
= B’Y |a,|? — BC a,b, — BC) 4,6; + |C|? > |b,|? 
= B*A — B\C|? 
= Rap = (C|”). 


n 


— 
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Since each term in the first sum is nonnegative, we see that 
B(AB — |C|?)>0. 
Since B > 0, it follows that AB — |C|* > 0. This is the desired inequality. 


EUCLIDEAN SPACES 


1.36 Definitions For each positive integer k, let R* be the set of all ordered 
k-tuples 

N= (%.%....., 0 
where x,, ..., X, are real numbers, called the coordinates of x. The elements of 


R* are called points, or vectors, especially when k > 1. We shall denote vectors 
by boldfaced letters. If y = (, ..., »,) and if a is a real number, put 


x+ty=(y + Vi, +s X + Vx) 
ax = @x,, ..., @%,) 
so that x + ye R* and axe R*. This defines addition of vectors, as well as 
multiplication of a vector by a real number (a scalar). These two operations 
satisfy the commutative, associative, and distributive laws (the proof is trivial, 
in view of the analogous laws for the real numbers) and make R* into a vector 
space over the real field. The zero element of R* (sometimes called the origin or 
the null vector) is the point 0, all of whose coordinates are 0. 
We also define the so-called ‘‘inner product”’ (or scalar product) of x and 
y by 
k 
xy = 2* iD 
and the norm of x by 


k , 1/2 
il te 0? =($ x) 


The structure now defined (the vector space R* with the above inner 
product and norm) is called euclidean k-space. 


1.37 Theorem Suppose x, y,z¢ R*, and « is real. Then 


(a) |x| 20; 
(6) |x| =0 if and only ifx =0; 
(c) lax] = |a||x]; 


(@) | y| < |xlyl; 
(e) |x+y| <|x| + lyl; 
Gf) |x-2z| s |x—y| + ly —2}. 


THE REAL AND COMPLEX NUMBER SYSTEMS 17 


Proof (a), (6), and (c) are obvious, and (d) is an immediate consequence 
of the Schwarz inequality. By (d) we have 


poPyp ar yy Sy) 
=x'x+2x:yt+y-y 
< |x|? + 2|x| ly] + ly|? 
= (|x| + lyl)’, 


so that (e) is proved. Finally, (f/) follows from (e) if we replace x by 
x—yandy by y —z. 


1.38 Remarks Theorem 1.37 (a), (6), and (/) will allow us (see Chap. 2) to 
regard R* as a metric space. 

R' (the set of all real numbers) is usually called the line, or the real line. 
Likewise, R? is called the plane, or the complex plane (compare Definitions 1.24 
and 1.36). In these two cases the norm is just the absolute value of the corre- 
sponding real or complex number. 


APPENDIX 


Theorem 1.19 will be proved in this appendix by constructing R from Q. We 
shall divide the construction into several steps. 


Step 1 The members of R will be certain subsets of Q, called cuts. A cut is, 
by definition, any set a c Q with the following three properties. 


(I) ais not empty, « 4 Q. 
(11) If pea, ge Q, and gq <p, thenqgea. 
(I1l) Ifpea, then p <r for some rea. 


The letters p, 9, r, ... will always denote rational numbers, and a, f, y, ... 
will denote cuts. 

Note that (II1) simply says that a has no largest member; (II) implies two 
facts which will be used freely: 


If pea and g ga then p <q. 
Ifr¢daandr<sthens¢a. 


Step 2 Define ‘‘« < f’’ to mean: a is a proper subset of . 

Let us check that this meets the requirements of Definition 1.5. 

If a < Band B < 7 it is clear that « < y. (A proper subset of a proper sub- 
set is a proper subset.) It is also clear that at most one of the three relations 


a< Bp, «= £, B<a 
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can hold for any pair x, f. To show that at least one holds, assume that the 
first two fail. Then x is not a subset of 6. Hence there is a pea with p¢ Bp. 
If ge B, it follows that g < p (since p¢f), hence qea, by (Il). Thus B ca. 
Since B # «, we conclude: f <a. 

Thus R is now an ordered set. 


Step 3. The ordered set R has the least-upper-bound property. 

To prove this, let 4 be a nonempty subset of R, and assume that Be R 
is an upper bound of A. Define ; to be the union of allxe A. In other words, 
pey if and only if pe x for some xe A. We shall prove that ye R and that 
y = sup A. 

Since 4 is not empty. there exists an %) € A. This x is not empty. Since 
% <y¥, 71S not empty. Next, ; < f (since x c f for every « € A), and therefore 
y #Q. Thus » satisfies property (1). To prove (11) and (III), pick pe y. Then 
pex, for some x,€A. If g<p, then gex,, hence ge jy; this proves (Il). If 
rex, is so chosen that r > p, we see that re y (since «, < y), and therefore y 
satisfies (IIT). 

Thus ye R. 

It is clear that « < 3 for every xe A. 

Suppose 0 < 7. Then there is an sey and that s¢0. Since sey, sea 
for some 2€ A. Hence 6 < x, and o is not an upper bound of A. 

This gives the desired result: y = sup A. 


Step 4 Ifae Rand fe R we define « + f to be the set of all sums r + 5s, where 
rexand se fp. 
We define 0* to be the set of all negative rational numbers. It is clear that 
O* is acut. We verify that the axioms for addition (see Definition 1.12) hold in 
R, with 0* playing the role of 0. 
(Al) We have to show that x + f is a cut. It is clear that a + B is a 
nonempty subset of Q. Take r'¢a, s’'¢f. Then r'+s5'>r4-s for all 
choices of rex, se ff. Thus r’+s5'¢x%+ f. It follows that a + B has 
property (1). 

Pick pex+f. Then p=r+s, with rea, sep. If q<p, then 
q—-s<r, sog-—sex, and gq=(q-—s)+sea+f. Thus (Il) holds. 
Choose rex sothatt>r. Thenp<t+sandt+sex+ fp. Thus (II) 
holds. 

(A2) x + Bis the set of allr + 5, withrea,s eB. By the same definition, 
B +a is the set of alls +r. Since r+s=s+,r for allre Q, se Q, we 
have « + B = B +. 

(A3) As above, this follows from the associative law in Q. 

(A4) Ifrexandse0*, thenr+s<r,hencer+ sex. Thusa+0* ca. 
To obtain the opposite inclusion, pick pea, and pick rea,r>p. Then 
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p—re0*, and p=r+(p—r)ea+0*. Thus «ca+0*. We conclude 
that a + 0* =a. 


(AS) Fix ae R. Let B be the set of all p with the following property: 
There exists r > 0 such that —p—ré¢«u. 


In other words, some rational number smaller than —p fails to 
be in a. 

We show that B € R and that a + B = 0*. 

Ifs¢éa and p= —s—1, then —p—1 ¢a, hence pe B. So B is not 
empty. Ifgea, then —G¢f. SofB #Q. Hence f satisfies (1). 

Pick pe f, and pick r>0, so that —p—réa. If q<p, then 
—q-~r>-—-p-—r, hence —q-—réa. Thus ge, and (II) holds. Put 
t=p+(r/2). Then t>p, and —t—(r/2)= —p—ré«, so that te. 
Hence £ satisfies (111). 

We have proved that fe R. 

If reaand se pf, then —s éa, hence r< —s, r+s<0. Thus 
a+BcO0*. 

To prove the opposite inclusion, pick ve 0*, put w = —v/2. Then 
w > 0, and there 1s an integer n such that nwea but (n+ l)w¢éa. (Note 
that this depends on the fact that Q has the archimedean property!) Put 
p= —(n+2)w. Then pe f, since —p — w ¢ a, and 


v=nwt+peat BP. 
Thus 0* ca + £. 
We conclude that « + B = 0*. 
This B will of course be denoted by —z. 


Step 5 Having proved that the addition defined in Step 4 satisfies Axioms (A) 
of Definition 1.12, it follows that Proposition 1.14 1s valid in R, and we can 
prove one of the requirements of Definition 1.17: 


Ifa, B, ye Rand B <y, thna+Bp<at+y. 


Indeed, it is obvious from the definition of + in R thata+Pcady; if 
we had a+ B=a+y, the cancellation law (Proposition 1.14) would imply 
B= y. 


It also follows that « > 0* if and only if —a« < 0*. 


Step 6 Multiplication is a little more bothersome than addition in the present 
context, since products of negative rationals are positive. For this reason we 
confine ourselves first to R*, the set of all xe R with x > 0*. 

Ifae R* and Be R*, we define xf to be the set of all p such that p < rs 
for some choice of rea, se B, r>0,5>0. 

We define 1* to be the set of all g < I. 
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Then the axioms (M) and (D) of Definition 1.12 hold, with R* in place of F, 


and with 1* in the role of 1. 
The proofs are so similar to the ones given in detail in Step 4 that we omit 


them. 
Note, in particular, that the second requirement of Definition 1.17 holds: 


If « > O* and B > 0* then af > 0*. 


Step 7 We complete the definition of multiplication by setting «0* = 0*a = 0*, 
and by setting 
(— fp, the<@, Pe 0*, 
aB= (-—[(-—a)B] ifa<0O*, B>O0*, 
—[a-(-B)] ifa>0*, B<0*. 
The products on the right were defined in Step 6. 
Having proved (in Step 6) that the axioms (M) hold in R*, it is now 
perfectly simple to prove them in R, by repeated application of the identity 


= —(—y) which is part of Proposition 1.14. (See Step 5.) 
The proof of the distributive law 


a(B + y)=aB + ay 
breaks into cases. For instance, suppose « >0*, B <0*, B+y>0*. Then 
y= (6 + y) + (—8), and (since we already know that the distributive law holds 
in R*) 

ay =a(B + y) +a -(—8). 

But a: (—f) = —(aB). Thus 

aB+ay =a(B + y). 
The other cases are handled in the same way. 


We have now completed the proof that R is an ordered field with the least- 
upper-bound property. 


Step 8 We associate with each re Q the set r* which consists of all pe Q 
such that p <r. It is clear that each r* is a cut; that is, r* € R. These cuts satisfy 
the following relations: 


(a) rv +e=(0 2857, 
(6) r¥s* = (rs)*, 
(c) r* <s* if and only ifr <:s. 


To prove (a), choose per* +s*. Then p=u+v, where u<r, v<s. 
Hence p <r +s, which says that pe(r + s)*. 
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Conversely, suppose pe(r+s)*. Then p<r+s. Choose ¢ so that 
2t=r+s-—p, put 
r=r-—t,s' =s—t. 


Bien'r.6/*,.s cst,andp =r’ 4.s',so.that pe r* +.s*. 

This proves (a). The proof of (4) is similar. 

Ifr<sthenres*, but r¢r*; hence r* < s*. 

If r* <s*, then there is a pes* such that p¢r*. Hence r<p<s, so 
thatr<s. 

This proves (c). 


Step 9 We saw in Step 8 that the replacement of the rational numbers r by the 
corresponding “‘rational cuts’ r* € R preserves sums, products, and order. This 
fact may be expressed by saying that the ordered field Q is isomorphic to the 
ordered field Q* whose elements are the rational cuts. Of course, r* is by no 
means the same as r, but the properties we are concerned with (arithmetic and 
order) are the same in the two fields. 

It is this identification of Q with Q* which allows us to regard QO as a 
subfield of R. 

The second part of Theorem 1.19 is to be understood in terms of this 
identification. Note that the same phenomenon occurs when the real numbers 
are regarded as a subfield of the complex field, and it also occurs at a much 
more elementary level, when the integers are identified with a certain subset of Q. 

It is a fact, which we will not prove here, that any two ordered fields with 
the least-upper-bound property are isomorphic. The first part of Theorem 1.19 
therefore characterizes the real field R completely. 


The books by Landau and Thurston cited in the Bibliography are entirely 
devoted to number systems. Chapter 1 of Knopp’s book contains a more 
leisurely description of how R can be obtained from Q. Another construction, 
in which each real number is defined to be an equivalence class of Cauchy 
sequences of rational numbers (see Chap. 3), is carried out in Sec. 5 of the book 
by Hewitt and Stromberg. 

The cuts in Q which we used here were invented by Dedekind. The 
construction of R from Q by means of Cauchy sequences is due to Cantor. 
Both Cantor and Dedekind published their constructions in 1872. 


EXERCISES 


Unless the contrary is explicitly stated, all numbers that are mentioned in these exer- 
cises are understood to be real. 


1. If r is rational (r 0) and x is irrational, prove that r + x and rx are irrational. 
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2. Prove that there is no rational number whose square is 12. 

3. Prove Proposition 1.15. 

4. Let E be a nonempty subset of an ordered set; suppose « is a lower bound of E 
and § is an upper bound of E. Prove that « <P. 

5. Let A be a nonempty set of real numbers which is bounded below. Let —A be 
the set of all numbers — x, where x € A. Prove that 


inf A = —sup(— A). 
& Freh> 1. 
(a) If m, n, p, q are integers, n > 0, q >0, and r = m/n = p/q, prove that 
ee = (b°)'"¢, 


Hence it makes sense to define 6’ = (b")!"*. 

(b) Prove that b’** = 6’b' if r and s are rational. 

(c) If x is real, define B(x) to be the set of all numbers b', where ¢ is rational and 
t<.x. Prove that 


b’ = sup B(r) 
when r is rational. Hence it makes sense to define 
b* = sup B(x) 


for every real x. 
(d) Prove that b**” = b*b” fc. all real x and y. 

7. Fix b>1, » >0, and prove that there is a unique real x such that b* = y, by 
completing the following outline. (This x is called the logarithm of y to the base b.) 
(a) For any positive integer m, b*— 1 >n(b— 1). 

(b) Hence 6 — 1 >n(b'™ — 1). 

(c) Ift>1andn>(b— 1)/(1— 1), then b'" <7. 

(d) If w is such that 6” < y, then 6”*‘'™ < y for sufficiently large n; to see this, 
apply part (c) with t=y-5b-”. 

(e) If b > y, then b¥-“'™ > y for sufficiently large 7. 

(f) Let A be the set of all w such that b” < y, and show that x = sup A satisfies 
=» 

(g) Prove that this x is unique. 


8. Prove that no order can be defined in the complex field that turns it into an ordered 
field. Hint: —1 is a square. 

9. Suppose z=a+ bi, w=c+di. Define z<w if a<c, and also if a=c but 
b<d. Prove that this turns the set of all complex numbers into an ordered set. 
(This type of order relation is called a dictionary order, or lexicographic order, for 
obvious reasons.) Does this ordered set have the least-upper-bound property ? 

10. Suppose z=a+ bi, w=u + iv, and 


fren” >7(-lfeliaa 
ao— 7 ’ = 2 : 


11. 


12. 


43: 


14. 


15. 
16. 


17. 


18. 


19. 


20. 
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Prove that z? = w if v > 0 and that (z)? = wif v <0. Conclude that every complex 
number (with one exception!) has two complex square roots. 

If z is a complex number, prove that there exists an r >0 and a complex number 
w with |w| =1 such that z=rw. Are w and r always uniquely determined by z? 
If z;,..., Z, are complex, prove that 


[een treme prez lee ae PE fie | HL fe 
If x, y are complex, prove that 
xi — Di = I: 
If z is a complex number such that |z| = 1, that is, such that zZ = 1, compute 
[1+ 2z|/7+ [1—2|?. 


Under what conditions does equality hold in the Schwarz inequality ? 
Suppose k > 3, x, ye R*, |x —y| =d>0, andr>0. Prove: 
(a) If 2r > d, there are infinitely many z € R* such that 


|z—x| =|z—yl =r. 


(b) If 2r = d, there is exactly one such z. 
(c) If 2r < d, there is no such z. 
How must these statements be modified if & is 2 or 1? 
Prove that 
[x + y|? + |x — yl]? =2|x|? + 2[y/? 
if xe R* and ye R*. Interpret this geometrically, as a statement about parallel- 
ograms. 
If k >2 and xe R*, prove that there exists y € R* such that y #0 but x-y = 0. 


Is this also true if k = 1? 
Suppose a é€ R*,b € R*. Find ce R* and r > 0 such that 


|x —a]l =2|x—bD| 
if and only if |x —c| =r. 
(Solution: 3c = 4b — a, 3r = 2|b— al.) 
With reference to the Appendix, suppose that property (III) were omitted from the 
definition of a cut. Keep the same definitions of order and addition. Show that 


the resulting ordered set has the least-upper-bound property, that addition satisfies 
axioms (A!) to (A4) (with a slightly different zero-element!) but that (A5) fails. 


2 


BASIC TOPOLOGY 


FINITE, COUNTABLE, AND UNCOUNTABLE SETS 


We begin this section with a definition of the function concept. 


2.1 Definition Consider two sets A and B, whose elements may be any objects 
whatsoever, and suppose that with each element x of A there is associated, in 
some manner, an element of B, which we denote by f(x). Then fis said to be a 
function from A to B (or a mapping of A into B). The set A is called the domain 
of f (we also say fis defined on A), and the elements f(x) are called the values 
of f. The set of all values of fis called the range of f. 


2.2 Definition Let A and B be two sets and let f be a mapping of A into B. 
If Ec A, f(E) is defined to be the set of all elements f(x), for xe E. We call 
T(E) the image of E under f. In this notation, f(A) is the range of f. It is clear 
that f(A) < B. If f(A) = B, we say that f maps A onto B. (Note that, according 
to this usage, onto is more specific than into.) 

If E — B, f~'(E) denotes the set of all x e A such that f(x) e E. We call 
f~' (E) the inverse image of E under f. If ye B, f~'(y) is the set of all xe A 
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such that f(x) = y. If, for each ye B, f~'(1) consists of at most one element 
of A, then f is said to be a 1-1 (one-to-one) mapping of -1 into 8. This may 
also be expressed as follows: f is a 1-1 mapping of A into B provided that 
F(x, )# f (x2) Whenever x, x55, € A, x, EA. 

(The notation x, # x, means that x, and x, are distinct elements; otherwise 
we write xX, = X2.) 


2.3 Definition If there exists a 1-1 mapping of A onto B, we say that A and B, 
can be put in 1-1 correspondence, or that A and B have the same cardinal number, 
or briefly, that A and B are equivalent, and we write A ~ B. This relation clearly 
has the following properties: 


It is reflexive: A ~ A. 
It is symmetric: If A ~ B, then B ~ A. 
It is transitive: If dA ~ Band B~C, then 4A ~ C. 


Any relation with these three properties is called an equivalence relation. 


2.4 Definition For any positive integer n, let J, be the set whose elements are 
the integers 1, 2, ..., 1; let J be the set consisting of all positive integers. For any set 
A, we Say: 


(a) A is finite if A~J, for some n (the empty set is also considered to be 
finite). 

(b) A is infinite if A is not finite. 

(c) A is countable if A ~ J. 

(d) A is uncountable if A is neither finite nor countable. 

(e) A is at most countable if A is finite or countable. 


Countable sets are sometimes called enumerable, or denumerable. 

For two finite sets A and B. we evidently have 1 ~ Bil and only if fand 
B contain the same number of elements. For infinite sets, however. the idea of 
“having the same number of elements’ becomes quite vague. whereas the notion 
of 1-1 correspondence retains its clarity. 


2.5 Example Let 4 be the set of all integers. Then 4 is countable. Por, 
consider the following arrangement of the sets A and J: 
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We can, in this example, even give an explicit formula for a function f 
from J to A which sets up a I-1 correspondence: 


F (n even), 


f(n) =- =i 
-35 (n odd). 


2.6 Remark A finite set cannot be equivalent to one of its proper subsets. 
That this is, however, possible for infinite sets, is shown by Example 2.5, in 
which J is a proper subset of A. 

In fact, we could replace Definition 2.4(b) by the statement: A is infinite if 
A is equivalent to one of its proper subsets. 


2.7 Definition By a sequence, we mean a function f defined on the set J of all 
positive integers. If f(n) = x,, for ne J, it is customary to denote the sequence 
f by the symbol {x,}, or sometimes by x,, x,,x3,.... The values of f, that is, 
the elements x,,, are called the rerms of the sequence. If A is a set and if x, € A 
for all n e J, then {x,} is said to be a sequence in A, or a sequence of elements of A. 

Note that the terms x,, x,, x3, ... of a sequence need not be distinct. 

Since every countable set is the range of a 1-1 function defined on J, we 
may regard every countable set as the range of a sequence of distinct terms. 
Speaking more loosely, we may say that the elements of any countable set can 
be “‘arranged in a sequence.”’ 

Sometimes it is convenient to replace J in this definition by the set of all 
nonnegative integers, 1.e., to start with 0 rather than with 1. 


2.8 Theorem Every infinite subset of a countable set A is countable. 


Proof Suppose E c A, and E is infinite. Arrange the elements x of A in 
a sequence {x,} of distinct elements. Construct a sequence {n,} as follows: 

Let n, be the smallest positive integer such that x,,¢ £. Having 
chosen n,,..., %—1(k = 2, 3, 4, ...), let mp, be the:smallest, integersgreater 
than m,_, such that x,, € E. 

Putting f(k) = x,, (kK = 1, 2, 3, ...), we obtain a 1-1 correspondence 
between E and J. 

The theorem shows that, roughly speaking, countable sets represent 
the “‘smallest’’ infinity: No uncountable set can be a subset of a countable 
set. 


2.9 Definition Let A and Q be sets, and suppose that with each element « of 
A there is associated a subset of Q which we denote by £,. 
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The set whose elements are the sets E, will be denoted by {E,}. Instead 
of speaking of sets of sets, we shall sometimes speak of a collection of sets, or 
a family of sets. 

The union of the sets E, is defined to be the set S such that x € S if and only 
if xe E, for at least one ae A. We use the notation 


(1) S= |) &,. 
aceA 
If A consists of the integers 1, 2,...,, one usually writes 
(2) S=UE, 
m= 1 
or 
(3) me, Ce cee, 


If A is the set of all positive integers, the usual notation is 
(4) Sal) eae 


The symbol oo in (4) merely indicates that the union of a countable col- 
lection of sets is taken, and should not be confused with the symbols +00, —o, 
introduced in Definition 1.23. 

The intersection of the sets E,, is defined to be the set P such that x « P if 
and only if x « E,, for every a « A. We use the notation 


(5) iin 2 oe 
aed 
or 
(6) ae. we ee: Tome 
m= | 
Or 
(7) 22 
m=1 


as for unions. If AA B is not empty, we say that A and B intersect; otherwise they 
are a sjoint. 
2.10 Examples 


(a) Suppose E consists of 1, 2, 3 and &; consists of 2, 3, 4. Then 
E, VE, consists of 1, 2, 3, 4, whereas E, 7 E, consists of 2, 3. 
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(by Let A be the set of real numbers x such that 0 <x <1. For every 
x eA, let E, be the set of real numbers y such that 0 < y< x. Then 


(i) E, ¢ E, if and only if0<x<z<1; 
(ii) v) E,=E,; 

xeA 
(iii) () E, is empty; 

xeA 


(i) and (ii) are clear. To prove (iii), we note that for every y > 0, y¢ E, 
ifx=y. Hienee y €7/),.., ©x- | 


2.11 Remarks Many properties of unions and intersections are quite similar 
to those of sums and products, in fact, the words sum and product were some- 
times used in this connection, and the symbols 2 and [1 were written in place 


of |) and (). 


The commutative and associative laws are trivial: 
(8) AUB=BUA; ANB=BQOA. 
(9) (AO Bue SHu (Be C); (A AB) ovrC =AWBA C). 


Thus the omission of parentheses in (3) and (6) is justified. 
The distributive law also holds: 


(10) Anu C=C a) veo ©: 


To prove this, let the left and right members of (10) be denoted by E and F, 
respectively. 

Suppose xe E. Then xe A and xe BUC, that is, xe B or x € C (pos- 
sibly both). Hence xe AN Bor xE€ ANC, so that xe F. Thus Ec F. 

Next, suppose xe F. Then x€ AN Bor xE ANC. That is, xe A, and 
xe BucC. Hencexe An(BUC), so that Fc E. 

It follows that E = F. 

We list a few more relations which are easily verified: 


(11) AcCAUB, 

(12) , AnNBeH 

If 0 denotes the empty set, then 

(13) A O0=A, An0d=0. 
If A c B, then 

(14) AUB=B, ANB=A. 
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2.12 Theorem Ler {E,},n = 1, 2,3, ..., be a sequence of countable sets, and put 


(15) S= U FE 
Then S is countable. “ 


Proof Let every set E, be arranged in a sequence {x,,}, k = 1, 2, 3,..., 
and consider the infinite array 


(16) 


in which the elements of E, form the mth row. The array contains all 
elements of S. As indicated by the arrows, these elements can be 
arranged in a sequence 


(7) X11 X215 X%125 X315 X225 X13 X41» X325%235%14;--- 


If any two of the sets E,, have elements in common, these will appear more 
than once in (17). Hence there is a subset 7 of the set of all positive 
integers such that S~ 7, which shows that S is at most countable 
(Theorem 2.8). Since E, < S, and E£, is infinite, S is infinite, and thus 
countable. 


Corollary Suppose A is at most countable, and, for every ae€ A, B, is at most 


countable. Put 
rte U BD, . 
aeA 


Then T is at most countable. 
For T is equivalent to a subset of (15). 


2.13 Theorem Let A be a countable set, and let B, be the set of all n-tuples 
(a,,..., ,), where a,€ A (k =1,...,n), and the elements a,,..., a, need not be 
distinct. Then B,, is countable. 


Proof That B, is countable is evident, since B, = A. Suppose B,-, 1s 
countable (n = 2, 3, 4,...). The elements of B, are of the form 


(18) (b, a) (be B,_,,a€ A). 


For every fixed b, the set of pairs (b, a) is equivalent to A, and hence 
countable. Thus B, is the union of a countable set of countable sets. By 
Theorem 2.12, B, is countable. 

The theorem follows by induction. 
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Corollary The set of all rational numbers is countable. 


Proof We apply Theorem 2.13, with m = 2, noting that every rational r 
is of the form b/a, where a and 6 are integers. The set of pairs (a, b), and 
therefore the set of fractions b/a, is countable. 


In fact, even the set of all algebraic numbers is countable (see Exer- 
cise 2). 

That not all infinite sets are, however, countable, is shown by the next 
theorem. | 


2.14 Theorem Let A be the set of all sequences whose elements are the digits 0 
and \. This set A is uncountable. 
The elements of A are sequences like 1,0,0,1,0,1,1,1,.... 


Proof Let E be a countable subset of A, and let E consist of the se- 
quences 5,,5),53,.... We construct a sequence s as follows. If the nth 
digit in s, is 1, we let the nth digit of s be 0, and vice versa. Then the 
sequence s differs from every member of E in at least one place; hence 
s¢E. But clearly s € A, so that E is a proper subset of A. 

We have shown that every countable subset of A is a proper subset 
of A. It follows that A is uncountable (for otherwise A would be a proper 
subset of A, which is absurd). 


The idea of the above proof was first used by Cantor, and is called Cantor’s 
diagonal process; for, if the sequences s,, 5,,53,,... are placed in an array like 
(16), it is the elements on the diagonal which are involved in the construction of 
the new sequence. 

Readers who are familiar with the binary representation of the real 
numbers (base 2 instead of 10) will notice that Theorem 2.14 implies that the 
set of all real numbers is uncountable. We shall give a second proof of this 
fact in Theorem 2.43. 


METRIC SPACES 


2.15 Definition A set X, whose elements we shall call points, is said to be a 
metric space if with any two points p and q of X there is associated a real 
number d(p, q), called the distance from p to q, such that 


(a) d(p,q) > 0 if p#4q; dp, p) =0; 
(6) d(p.q) = dq, p); 
(c) d(p,q) < d(p,r) + d(r,q), for any re X. 


Any function with these three properties is called a distance function, or 
a metric. 
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2.16 Examples The most important examples of metric spaces, from our 
standpoint, are the euclidean spaces R“, especially R! (the real line) and R? (the 
complex plane); the distance in R* is defined by 


(19) d(x, y) = |x-—y| («, 7 ER’). 


By Theorem 1.37, the conditions of Definition 2.15 are satisfied by (19). 

It is important to observe that every subset Y of a metric space X is a metric 
space in its own right, with the same distance function. For it is clear that if 
conditions (a) to (c) of Definition 2.15 hold for p, gq. re X. they also hold if we 
restrict p,q, rto lie in Y. 

Thus every subset of a euclidean space is a metric space. Other examples 
are the spaces @(K) and Y7?(), which are discussed in Chaps. 7 and 11, respec- 
tively. 


2.17 Definition By the segment (a, b) we mean the set of all real numbers x 
such thata<x <b. 

By the interval [a,b] we mean the set of all real numbers x such that 
a<x<b. 

Occasionally we shall also encounter “‘half-open intervals”’ [a, b) and (a, 5); 
the first consists of all « such that a < x <b, the second of all x such that 
qax =i 

Ifa, <b,fori=1,...,k, the set of all points x =(x,...., x,) in R* whose 
coordinates satisfy the inequalities a; < x; <6,;(1 <i<k) is called a k-cell. 
Thus a I-cell is an interval, a 2-cell is a rectangle, etc. 

If x e R* and r > 0, the open (or closed) ball B with center at x and radius r 
is defined to be the set of all ye R* such that |y —x| <r (or ly —x| <r). 

We call a set E c R* convex if 


Ax+(1—A)jyeE 


whenever xe E,ye E, and0</j< 1. 
For example, balls are convex. For if |y—x|<r.|z—x| <r, and 
0</A< 1, we have 


[Ay + (1 —A)z —x| = [Aly -- x) + (I — Az — x)| 
<Aly—x|+(1 —A)[z—x| <4r+(l-A)r 


er. 


The same proof applies to closed balls. It is also easy to see that k-cells are 
convex. 
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2.18 Definition Let X be a metric space. All points and sets mentioned below 
are understood to be elements and subsets of X. 


(a) A neighborhood of a point p is a set N,(p) consisting of all points g 
such that d(p,q) <r. The number r is called the radius of N,(p). 

(b) A point p is a limit point of the set E if every neighborhood of p 
contains a point q # p such that ge E. 

(c) If pe £ and p is not a limit point of E, then p is called an isolated 
point of E. : 

(d) E is closed if every limit point of E is a point of E. 

(e) A point p is an interior point of E if there is a neighborhood N of p 
such that N c E. 

({) Eis open if every point of E is an interior point of E. 

(g) The complement of E (denoted by E*) is the set of all points pe X 
such that p ¢ E. 

(h) E is perfect if E is closed and if every point of E is a limit point 
of E. 

(i) Eis bounded if there is a real number M and a point qe X such that 
d(p,q) < M for all pe E. 

(j) E is dense in X if every point of X is a limit point of E, or a point of 
E (or both). 


Let us note that in R’ neighborhoods are segments, whereas in R? neigh- 
borhoods are interiors of circles. 
2.19 Theorem Every neighborhood is an open set. 


Proof Consider,a neighborhood E = N,(p), and let q be any point of E. 
Then there is a positive real number / such that 


d(p,q) =r—h. 
For all points s such that d(q, s) < h, we have then 
d(p, s) < d(p,q)+ d(q,s)<r-—h+h=r, 
so that se E. Thus q is an interior point of E. 
2.20 Theorem // p is a limit point of a set E, then every neighborhood of p 
contains infinitely many points of E. 


Proof Suppose there is a neighborhood N of p which contains only a 
finite number of points of E. Let q,,...,q, be those points of N oq E, 
which are distinct from p, and put 


r= min d(p, gn) 
l<msn 
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[we use this notation to denote the smallest of the numbers d(p, q,), ..., 
d(p, q,)\. The minimum of a finite set of positive numbers is clearly posi- 
tive, so that r > 0. 

The neighborhood N,(p) contains no point q of E such that g # p, 
so that p is not a limit point of E. This contradiction establishes the 
theorem. 


Corollary A finite point set has no limit points. 


2.21 Examples Let us consider the following subsets of R?: 


(a) The set of all complex z such that |z| <1. 

(b) The set of all complex z such that |z| < 1. 

(c) A finite set. 

(d) The set of all integers. 

(e) The set consisting of the numbers I/n (n = 1, 2, 3,...). Let us note 
that this set E has a limit point (namely, z = 0) but that no point of E is 
a limit point of E; we wish to stress the difference between having a limit 
point and containing one. 

(f) The set of all complex numbers (that is, R?). 

(g) The segment (a, 5). 


Let us note that (d), (e), (g) can be regarded also as subsets of R'. 
Some properties of these sets are tabulated below: 


Closed Open Perfect Bounded 


(a) No Ves No Yes 
(b) Yes No Yes Yes 
(c) Yes No No Yes 
(d) Yes No No No 
(e) No No No Yes 
(Sf) Yes Yes Yes No 
(9) No No Yes 


In (g), we left the second entry blank. The reason is that the segment 
(a, b) is not open if we regard it as a subset of R’, but it is an open subset of Re. 


2.22 Theorem Let {E,} be a (finite or infinite) collection of sets E,. Then 
(20) (U ) = (69 


Proof Let A and B be the left and right members of (20). If xe 4, then 
x¢U, Ea, hence x ¢ E, for any a, hence x € E; for every x. so that v € (\ ES. 
Thus A c B. 
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2.23 


Conversely, if x € B, then x € Es for every «, hence x ¢ E, for any «, 
hence x ¢\), E,, so that xe(U, E,)’. Thus Bc A. 
It follows that A = B. 


Theorem A set E is open if and only if its complement is closed. 


Proof First, suppose E‘ is closed. Choose xe E. Then x ¢ E‘, and x is 
not a limit point of E°. Hence there exists a neighborhood N of x such 
that E‘ ON is empty, that is, N c E. Thus x is an interior point of E, 
and E is open. 

Next, suppose £ is open. Let x be a limit point of E°. Then every 
neighborhood of x contains a point of E‘, so that x is not an interior point 
of E. Since E is open, this means that x € E‘. It follows that E‘ is closed. 


Corollary A set F is closed if and only if its complement is open. 


2.24 


(21) 


Theorem 


(a) For any collection {G,\ of open sets, \), G, is open. 

(b) For any collection {F,} of closed sets, (\, F, is closed. 

(c) For any finite collection G,, ..., G, of open sets, (\?_, G; is open. 
(d) For any finite collection F,, ..., F,, of closed sets, \)7~, F; is closed. 


Proof Put G=\, Ge. if x eG,then x eG,forsome'e. Sinée xis an 
interior point of G,, x is also an interior point of G, and G is open. This 
proves (a). 

By Theorem 2.22, 


(1) Fa)’ = U (Fa), 


and Fs is open, by Theorem 2.23. Hence (a) implies that (21) is open so 
that (), F, is closed. 

Next, put H =()?7_, G;. For any xe H, there exist neighborhoods 
N, of x, with radi 7;, such that N; (G,;(@=1,...,m). Put 


r= mings... 0a 


and Jet N be the neighborhood of x of radius r. Then N c G; for i =1, 
...,”, so that N c H, and H 1s open. 
By taking complements, (d) follows from (c): 


(U Fi) = (eo. 
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2.25 Examples _ In parts (c) and (d) of the preceding theorem, the finiteness of 
the collections is essential. For let G, be the segment (- J -} = 24,3...) 
nn} 
Then G,, is an open subset of R’. Put G = ()%_, G,. Then G consists of a single 
point (namely, x = 0) and is therefore not an open subset of R’. 
Thus the intersection of an infinite collection of open sets need not be open. 
Similarly, the union of an infinite collection of closed sets need not be closed. 


2.26 Definition If X is a metric space, if E < X, and if E’ denotes the set of 
all limit points of E in X, then the closure of E is the set E=Eu E’. 


2.27 Theorem /f X is a metric space and E < X, then 


(a) E is closed, 
(6) E=E ifand only if E is closed, 
(c) EF for every closed set F < X such that E c F. 


By (a) and (c), E 1s the smallest closed subset of X that contains E. 


Proof 

(a) Ifpe Xandp¢ E then pis neither a point of E nor a limit point of E. 
Hence p has a neighborhood which does not intersect E. The complement 
of E is therefore open. Hence E is closed. 

(b) If E=E, (a) implies that E is closed. If E is closed, then E’ cE 
[by Definitions 2.18(d) and 2.26], hence E = E. 

(c) If Fis closed and F > E, then F > F’, hence F > E’. Thus F> E. 


2.28 Theorem Let E be anonempty set of real numbers which is bounded above. 
Let y =sup E. Thenye E. Hence ye E if E is closed. 


Compare this with the examples in Sec. 1.9. 


Proof If ye E then ye E. Assume y¢E. For every h > 0 there exists 
then a point x € E such that y —h < x < y, for otherwise y — h would be 
an upper bound of E. Thus » is a limit point of E. Hence j € E. 


2.29 Remark Suppose Ec Yc X, where X is a metric space. To say that E 
is an open subset of X means that to each point pe E there is associated a 
positive number r such that the conditions d(p,q)<r,ge x imply that q € E. 
But we have already observed (Sec. 2.16) that Y is also a metric space, so that 
our definitions may equally well be made within Y. To be quite explicit, let us 
say that E is open relative to Y if to each pe E there is associated an r > 0 such 
that qe E whenever d(p,q) <r and qe Y. Example 2.21(g) showed that a set 
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may be open relative to Y without being an open subset of ¥. However, there 
is a simple relation between these concepts, which we now state. 


2.30 Theorem Suppose Y< X. A subset E of Y is open relative to Y if and 
only if E = Y a G for some open subset G of X. 


Proof Suppose £ is open relative to Y. To each pe E there is a positive 
number r, such that the conditions d(p.q) <r,.q¢€ Y imply that qe E. 
Let V, be the set of ail qe X such that d(p,q) < r,, and define 
Ge bile 
pee 

Then G is an open subset of X, by Theorems 2.19 and 2.24. 

Since pe V, for all pe E, it is clear that EcGno Y. 

By our choice of V,, we have V, 7 Yc E for every pe E, so that 
GoyYcE. Thus E=Gno Y, and one half of the theorem is proved. 

Conversely, if G is open in X and E=Gno Y, every pe E has a 
neighborhood V, c G. Then V, 4 Yc E, so that E is open relative to Y. 


COMPACT SETS 


2.31 Definition By an open cover of a set E in a metric space X¥ we mean a 
collection {G,} of open subsets of X such that Ec , G,. 


2.32 Definition A subset K of a metric space X is said to be compact if every 
open cover of K contains a finite subcover. 

More explicitly, the requirement is that if {G,} is an open cover of K, then 
there are finitely many indices a,,..., a, such that 


£¢€6, Oe... 


The notion of compactness is of great importance in analysis, especially 
in connection with continuity (Chap. 4). 

It is clear that every finite set is compact. The existence of a large class of 
infinite compact sets in R* will follow from Theorem 2.41. 

We observed earlier (in Sec. 2.29) that if E< Yc X, then E may be open 
relative to Y without being open relative to ¥. The property of being open thus 
depends on the space in which E is embedded. The same is true of the property 
of being closed. 

Compactness, however, behaves better, as we shall now see. To formu- 
late the next theorem. let us say, temporarily, that K is compact relative to X if 
the requirements of Definition 2.32 are met. ' 


2.38 
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Theorem Suppose Kc Yc X. Then K is compact relative to X if and 


only if K is compact relative to Y. 


By virtue of this theorem we are able, in many situations, to regard con- 


pact sets as metric spaces :n their own right, without paying any attenticn to 
any embedding space. In particular, although it makes little sense to talk of 
open spaces, or of closed spaces (every metric space X is an open subset of itself. 
and is aclosed subset of itself), it does make sense to talk of compact metric 
spaces. 


(22) 


(23) 


2.34 


2.35 


Proof Suppose K is compact relative to X. and let {V,} be a collection 
of sets, open relative to Y. such that Kc U), V’,. By theorem 2.30. there 
are sets G,, open relative to Y, such that V, = Y OG,. forall x; and since 
K is compact relative to Y, we have 


he @ we wy, 
for some choice of finitely many indices 7,,....%,. Since Kc Y, (22) 
implies 

RS Vig a, 


This proves that K is compact relative to Y. 

Conversely, suppose K is compact relative to Y. let {G,} be a col- 
lection of open subsets of ¥ which covers K, and put V, = YOG,. Then 
(23) will hold for some choice of a,,....%,; and since V,cG,, (23) 
implies (22). 

This completes the proof. 


Theorem Compact subsets of metric spaces are closed. 


Proof Let K be a compact subset of a metric space Y. We shall prove 
that the complement of K is an open subset of Y. 

Suppose pe Y.p¢ K. Ifqe K, let V, and W, be neighborhoods of p 
and qg, respectively. of radius less than 4d(p.q) [see Definition 2.18()] 
Since K is compact. there are finitely many points g,.....q, in A such that 


Rc Y,, wal ‘“ = Py. 


Re Sl, 0: -@~ Vy ethen PF ye neighborhood of p which does not 
intersect W. Hence Vc K*. so that p is an interior point of AS The 
theorem follows. 


Theorem Closed subsets of compact sets are compact. 


Proof Suppose Fc K c X. Fis closed (relative to NV). and A is compact 
Let {V,} be an open cover of F. If F° is adjoined to {},;. we obtain an 
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open cover 2 of K. Since K is compact, there is a finite subcollection ® 
of Q which covers K, and hence F. If F° is a member of ®, we may remove 
it from ® and still retain an open cover of F. We have thus shown that a 
finite subcollection of {V,} covers F. 


Corollary Jf F is closed and K is compact, then F ~ K is compact. 


Proof Theorems 2.24(6) and 2.34 show that F©K is closed; since 
F aKc K, Theorem 2.35 shows that F qn K is compact. 


2.36 Theorem /f{K,} is acollection of compact subsets of a metric space X such 
that the intersection of every finite subcollection of {K,} is nonempty, then (\ K, 
is nonempty. 


Proof Fix a member K, of {K,} and put G, = Kf. Assume that no point 
of K, belongs to every K,. Then the sets G, form an open cover of K;,; 
and since K, is compact, there are finitely many indices a,,..., a, such 
that K, ¢G,, U-::UG,,. But this means that 


Ki, Odea ede, 


is empty, in contradiction to our hypothesis. 


Corollary I[f {K,} is a sequence of nonempty compact sets such that K, > K,+, 
(m= 1, 29394.) dhen(\? Kis notempty. 


2.37 Theorem [/f E is an infinite subset of a compact set K, then E has a limit 
point in K. 


Proof If no point of K were a limit point of E, then each ge K would 
have a neighborhood V, which contains at most one point of E (namely, 
q, if ge E). It is clear that no finite subcollection of {V,} can cover E; 
and the same is true of K, since Ec K. This contradicts the compactness 
of K. 


2.38 Theorem If {/,} is a sequence of intervals in R', such that I, > 1,4; 
(n =1, 2, 3, ...), then ()\f I, is not empty. 


Proof If /, =[a,, 5,], let E be the set of all a,. Then E is nonempty and 
bounded above (by 5,). Let x be the sup of E. If m and n are positive 
integers, then 


a, = Ca = Deieiin Sy, 


so that x < b,, for each m. Since it is obvious that a,, < x, we see that 
xel,, for m = 1, 2, 3,. 


2.39 
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Theorem Let k be a positive integer. If {I,} is a sequence of k-cells such 


that I, > 1,4 ,(a = 1, 2,3, ...), then (\f I, is not empty. 


2.40 


Proof Let /, consist of all points x = (x,,..., x,) such that 
Wy Hy SO ( €%¢s oe wl, BSP. . 5, 


and put /, ; =(a,,;,5,,;]. For each j, the sequence {/, ;} satisfies the 
hypotheses of Theorem 2.38. Hence there are real numbers x7(1 <j < k) 
such that 

a,j SX <5, (hae, ale geri Age dy BP... d. 


Setting, xX* =Gl,......%), Wesee that x67, for #=1,.2,.2..... Tike 
theorem follows. 


Theorem Every k-cell is compact. 


Proof Let / be a k-cell, consisting of all points x =(x,, ..., x,) such 
that a; <x,<6,;(1<j<k). Put 


Then |x —y| <6, ifxetyel. 

Suppose, to get a contradiction, that there exists an open cover {G,} 
of J which contains no finite subcover of J. Put c; = (a; + b,)/2. The 
intervals [a,, c;] and [c;, b,] then determine 2* k-cells Q; whose union is /. 
At least one of these sets Q., call it 7;, cannot be covered by any finite 
subcollection of {G,} (otherwise J could be so covered). We next subdivide 
J, and continue the process. We obtain a sequence {/,} with the following 
properties: 


i) VY 2dy> > lL, >; 
(6b) J, is not covered by any finite subcollection of {G,}; 
(c) ifxe/,andye/,, then |x —y| <2°"6. 


By (a) and Theorem 2.39, there is a point x* which lies in every /,. 
For some a,x*eG,. Since G, is open, there exists r >0 such that 
ly —x*| <r implies that yeG,. If n is so large that 2°"6 <r (there is 
such an vn, for otherwise 2” < 6/r for all positive integers m, which 1s 
absurd since R is archimedean), then (c) implies that /, < G,, which con- 
tradicts (5). 

This completes the proof. 


The equivalence of (a) and (b) in the next theorem is known as the Heine- 


Borel theorem. 
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2.41 Theorem Jfa set E in R* has one of the following three properties, then it 
has the other two: 


(a) Eis closed and bounded. 
(b) Eis compact. 
(c) Every infinite subset of E has a limit point in E. 


Proof If (a) holds, then E </ for some k-cell 7, and (6) follows from 
Theorems 2.40 and 2.35. Theorem 2.37 shows that (6) implies (c). It 
remains to be shown that (c) implies (a). 

If E is not bounded, then E contains points x, with 


|e | oer (n = 1, 2, 3, ...). 


The set S consisting of these points x, is infinite and clearly has no limit 
point in R*, hence has none in E. Thus (c) implies that E is bounded. 

If E is not closed, then there is a point x, € R* which is a limit point 
of £ but not a pomt of £. Form = 1, 2,.3,..., tere ate POS yc EF 
such that |x, — Xx | <1/n. Let S be the set of these points x,. Then S is 
infinite (otherwise |x, —X,| would have a constant positive value, for 
infinitely many 1), S has xq as a limit point, and S has no other limit 
point in R“. For if ye R*, y # xo, then 


Ix, -y| 2 [xo —y| ~ hy 
| 
ae | || —S 5 Ixo— 
n 


for all but finitely many 7; this shows that y is not a limit point of S 
(Theorem 2.20). 


Thus S has no limit point in E; hence E must be closed if (c) holds. 


We should remark, at this point, that (6) and (c) are equivalent in any 
metric space (Laercise 26) but that (a) does not, in general, imply (b) and (c). 
Examples are furnished by Exercise 16 and by the space ¥Y?, which is dis- 
cussed in Chap. 11. 


2.42 Theorem (Weierstrass) Every bounded infinite subset of R* has a limit 
point in R*. 


Proof Being bounded, the set E in question is a subset of a k-cell Jc R*. 
By Theorem 2.40, J is compact, and so E£ has a limit siti in J, by 
Theorem 2.37. 
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PERFECT SETS 


2.43 Theorem Let P be a nonempty perfect set in R*. Then P is uncountable. 


Proof Since P has limit points, P must be infinite. Suppose P is count- 
able, and denote the points of P by x,, x,, x3,.... We shall construct a 
sequence {V,} of neighborhoods, as follows. 

Let V, be any neighborhood of x,. If V, consists of all y € R* such 
that jy — x,| <r, the closure V, of V, is the set of all ye R* such that 
ly =%u|.S. 

Suppose V,, has been constructed, so that V, © P is not empty. Since 
every point of P is a limit point of P, there is a neighborhood V,,,, such 
that (i) V4, cC V,, (ii) x, ¢ Via1, (ili) Via, OP is not empty. By (iii), 
V4, satisfies our induction hypothesis, and the construction can proceed. 

Put K, = V, OP. Since V, is closed and bounded, V, is compact. 
Sinee %, ¢ K,,,, no pomt of P lies in (\P K,. Sineé K,.e P, thisamplies 
that ()/ K, is empty. But each K, is nonempty, by (iii), and K, > K,41, 
by (i); this contradicts the Corollary to Theorem 2.36. 


Corollary Every interval [a, b] (a < b) is uncountable. In particular, the set of 
all real numbers is uncountable. 


2.44 The Cantor set The set which we are now going to construct shows 
that there exist perfect sets in R' which contain no segment. 

Let E> be the interval [0, 1]. Remove the segment (4, 4), and let E, be 
the union of the intervals 


(0, 3] [%, 1]. 


Remove the middle thirds of these intervals, and let E, be the union of the 
intervals 


(0, 3], (5, 3], [§. 3) (5, 1 
Continuing in this way, we obtain a sequence of compact sets E,,, such that 


(a) 6) Salige > Wags: 5 
(6b) E,, is the union of 2" intervals, each of length 3°”. 


The set 
P=) E, 
n= 1 


is called the Cantor set. P is clearly compact, and Theorem 2.36 shows that P 
is not empty. 
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No segment of the form 


(A ] 


(24) a 


where k and m are positive integers, has a point in common with P. Since every 
segment (a, 8) contains a segment of the form (24), if 


P contains no segment. 

To show that P is perfect, it is enough to show that P contains no isolated 
point. Let xe P, and let S be any segment containing x. Let /, be that interval 
of E, which contains x. Choose n large enough, so that J, < S. Let x, be an 
endpoint of /,, such that x, # x. 

It follows from the construction of P that x, € P. Hence x is a limit point 
of P, and P is perfect. 

One of the most interesting properties of the Cantor set is that it provides 
us with an example of an uncountable set of measure zero (the concept of 
measure will be discussed in Chap. 11). 


CONNECTED SETS 


2.45 Definition Two subsets A and B of a metric space X are said to be 
separated if both A > B and A a B are empty, ie., if no point of A lies in the 
closure of B and no point of B lies in the closure of A. 


A set Ec X is said to be connected if E is not a union of two nonempty 
separated sets. 


2.46 Remark Separated sets are of course disjoint, but disjoint sets need not 
be separated. For example, the interval [0, 1] and the segment (1, 2) are not 
separated, since | is a limit point of (1, 2). However, the segments (0, 1) and 
(1, 2) are separated. 

The connected subsets of the line have a particularly simple structure: 


2.47 Theorem A subset E of the real line R' is connected if and only if it has the 
following property: IfxeE, ye E,andx<z<_y, thenzeE. 


Proof If there exist x € E, ye E, and some z € (x, y) such that z ¢ E, then 
E =A, B, where 


A,=En(—©,2), B,=En(z, 0). 
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Since x € A, and ye B,, A and Bare nonempty. Since A, ¢ (— 0, z) and 
B, < (z, 0), they are separated. Hence E is not connected. 

To prove the converse, suppose E is not connected. Then there are 
nonempty separated sets A and Bsuch that AU B=E. Pick xe A, ye B, 
and assume (without loss of generality) that x < y. Define 


z= sup (A fn [x, y]). 


By Theorem 2.28, ze A; hence z¢ B. In particular, x <z < y. 

If z ¢ A, it follows that x < z< y and z¢ E. 

If ze A, then z ¢ B, hence there exists z, such that z <z, < y and 
z,¢B. Thenx <z, <y and z, ¢E. 


EXERCISES 


3 


Prove that the empty set is a subset of every set 


2. A complex number z is said to be algebraic if there are integers ao, ..., a,, not all 


Nn & WY 


zero, such that 
ee ae a areis + ay — 0. 


Prove that the set of all algebraic numbers is countable. Hint: For every positive 
integer N there are only finitely many equations with 


n+ |a@ol.+ jar| +--+: + |an| =. 


. Prove that there exist real numbers which are not algebraic. 

. Is the set of all irrational real numbers countable ? 

. Construct a bounded set of real numbers with exactly three limit points. 

. Let E’ be the set of all limit points of a set E. Prove that E’ is closed. Prove that 


E and E have the same limit points. (Recall that E = Eu E’.) Do Eand E’ always 
have the same limit points ? 


. Let A,, A2, As, ... be subsets of a metric space. 


(a) Vf Bu= | )?-1%4i,, provethat B, = me, Ap, form—1, 2,3,.... 
(6) if B= UPR, Av, prove that B> JP, Ai. 
Show, by an example, that this inclusion can be proper. 


. Is every point of every open set E< R? a limit point of E? Answer the same 


question for closed sets in R?. 


. Let E° denote the set of all interior points of a set E. [See Definition 2.18(e); 


E° is called the interior of E.] 

(a) Prove that E° is always open. 

(b) Prove that E is open if and only if E° = E. 

(c) If G< E and G is open, prove that G © E°. 

(d) Prove that the complement of E° is the closure of the complement of E. 
(e) Do E and E always have the same interiors ? 

(f) Do E and E” always have the same closures ? 


4 


10. 


11. 


12. 


13. 
14. 


56. 


16. 


i: 


18. 
yp. 


21. 
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Let X be an infinite set. For pe X and qe X, define 
1 (ifp #q) 

d(p, q) = | ’ 
0 (ifp =). 


Prove that this is a metric. Which subsets of the resulting metric space are open? 
Which are closed? Which are compact? 
For x € R' and ye R’, define 

d,(x, y) =(x— y)’, 

d2(x, y) = Vi|x—yl, 

d;(x, y) =|x? —y?|, 

d4(x, y) =|x — 2y|, 

| xm 9 

meatless ik 
Determine, for each of these, whether it is a metric or not. 
Let K < R' consist of 0 and the numbers 1/n, for n = 1, 2, 3,.... Prove that K is 
compact directly from the definition (without using the Heine-Borel theorem). 
Construct a compact set of real numbers whose limit points form a countable set. 
Give an example of an open cover of the segment (0, 1) which has no finite sub- 
cover. 
Show that Theorem 2.36 and its Corollary become false (in R', for example) if the 
word “‘compact”’ is replaced by “‘closed”’ or by “‘bounded.”’ 
Regard Q, the set of all rational numbers, as a metric space, with d(p, qg) =|p — q|. 
Let E be the set of all pe Q such that 2 < p? <3. Show that E is closed and 
bounded in Q, but that E is not compact. Is E open in Q? 
Let E be the set of all x €¢ (0. 1] whose decimal expansion contains only the digits 
4 and 7. Is Ecountable? Is E dense in [0, 1]? Is E compact? Is E perfect? 
Is there a nonempty perfect set in R' which contains no rational number? 
(a) If A and B are disjoint closed sets in some metric space Y, prove that they 
are separated. 
(b) Prove the same for disjoint open sets. 
(c) Fix pe X, 5 > 0, define A to be the set of all g € X for which d(p, q) < 5, define 
B similarly, with > in place of <. Prove that A and B are separated. 


(d) Prove that every connected metric space with at least two points is uncount- 
able. Hint: Use (c). 


. Are closures and interiors of connected sets always connected? (Look at subsets 


of R?.) 
Let A and B be separated subsets of some R*, suppose a € A, b € B, and define 


p(t) = (1 — rat tb 
for fe R'. Put Ao = p~'(A), Bo = p~'(B). [Thus te Ao if and only if p(t) € A.] 


22. 


23, 


24. 


26. 


26. 


mF. 


28. 


2. 
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(a) Prove that Ao and Bo are separated subsets of R'. 
(b) Prove that there exists fo € (0, 1) such that p(to) ¢ A U B. 
(c) Prove that every convex subset of R* is connected. 


A metric space is called separable if it contains a countable dense subset. Show 
that R* is separable. Hint: Consider the set of points which have only rational 
coordinates. 


A collection {V,} of open subsets of X is said to be a base for X if the following 
is true: For every x € X and every open set G< X such that xe G, we have 
xe V,<G for some «. In other words, every open set in X is the union of a 
subcollection of {V,}. 

Prove that every separable metric space has a countable base. Hint: Take 
all neighborhoods with rational radius and center in some countable dense subset 
of X. 


Let Y be a metric space in which every infinite subset has a limit point. Prove that 
X is separable. Hint: Fix 6 >0, and pick x, € X. Having chosen x,,..., x,€ X, 
enoose,.x;+, € X, if possible, so that d(x, x,+1)=>6 for i=1, ...,/. Show that 
this process must stop after a finite number of steps, and that X can therefore be 
covered by finitely many neighborhoods of radius 6. Take 6 = 1I/n(n = 1, 2,3,...), 
and consider the centers of the corresponding neighborhoods. 


Prove that every compact metric space K has a countable base, and that K is 
therefore separable. Hint: For every positive integer , there are finitely many 
neighborhoods of radius 1/7 whose union covers K. 


Let X be a metric space in which every infinite subset has a limit point. Prove 
that Y is compact. Hint: By Exercises 23 and 24, X has a countable base. It 
follows that every open cover of X has a countable subcover {G,}, n = 1, 2, 3,.... 
If no finite subcollection of {G,; covers X, then the complement F, of G; U-::UG, 
is nonempty for each 1, but ()F, is empty. If E is a set which contains a point 
from each F,, consider a limit point of E, and obtain a contradiction. 


Define a point p in a metric space X to be a condensation point of a set Ec X if 
every neighborhood of p contains uncountably many points of E. 

Suppose E < R‘, E is uncountable, and let P he ihe set of all condensation 
points of E. Prove that P is perfect and that at most countably many points of E 
are not in P. In other words, show that P* ME is at most countable. Hint: Let 
{V,; be a countable base of R*, let W be the union of those V, for which E «- V, 
is at most countable, and show that P = W“. 


Prove that every closed set in a separable metric space is the union of a (possibly 
empty) perfect set and a set which is at most countable. (Corellary: Every count- 
able closed set in R* has isolated points.) Hint: Use Exercise 27. 


Prove that every open set in R' is the union of an at most countable collection of 
disjoint segments. Hint: Use Exercise 22. 
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30. Imitate the proof of Theorem 2.43 to obtain the following result: 


If R* = | )?F,, where each F, is a closed subset of R*, then at least one F, 
has a nonempty interior. 


Equivalent statement: If G, is a dense open subset of R*, for n = 1, 2, 3,..., 
then (\fG, is not empty (in fact, it is dense in R*). 


(This is a special case of Baire’s theorem; see Exercise 22, Chap. 3, for the genera! 
case.) 


3 


NUMERICAL SEQUENCES AND SERIES 


As the title indicates, this chapter will deal primarily with sequences and series 
of complex numbers. The basic facts about convergence, however, are just as 
easily explained in a more general setting. The first three sections will therefore 
be concerned with sequences in euclidean spaces, or even in metric spaces. 


CONVERGENT SEQUENCES 


3.1 Definition A sequence {p,} in a metric space X is said to converge if there 
is a point p € X with the following property: For every € > 0 there is an integer 
N such that n > N implies that d(p,, p) < e. (Here d denotes the distance in X.) 

In this case we also say that {p,} converges to p, or that p is the limit of 
{pn} [see Theorem 3.2(b)], and we write p, > p, or 


lim p, = Pp. 


noo 


If {p,} does not converge, it is said to diverge. 
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It might be well to point out that our definition of “‘convergent sequence”’ 
depends not only on {p,} but also on X; for instance, the sequence {1/n} con- 
verges in R' (to 0), but fails to converge in the set of all positive real numbers 
[with d(x, y)=|x—y|]. In cases of possible ambiguity, we can be more 
precise and specify ‘‘convergent in X”’ rather than ‘‘convergent.”’ 

We recall that the set of all points p, (n = 1, 2, 3, ...) is the range of {p,}. 
The range of a sequence may be a finite set, or it may be infinite. The sequence 
{p,} is said to be bounded if its range is bounded. 

As examples, consider the following sequences of complex numbers 
(thateis; X = R’): 


(a) Ifs, = 1/n, then lim,_.,, 5, = 0; the range is infinite, and the sequence 
is bounded. 

(b) If s,=n*, the sequence {s,} is unbounded, is divergent, and has 
infinite range. 

(c) If s, = 1+ [(— 1)"/n], the sequence {s,} converges to 1, is bounded, 
and has infinite range. 

{d) If s, =i", the sequence {s,} is divergent, is bounded, and has finite 
range. 

(e) If s,=1(m=1, 2,3,...), then {s,} converges to 1, is bounded, and 
has finite range. 


We now summarize some important properties of convergent sequences 
in metric spaces. 


3.2 Theorem Let {p,} be a sequence in a metric space X. 


(a) {p,} converges to p € X if and only if every neighborhood of p contains 
all but finitely many of the terms of {p,\. 

(b) IfpeX, p' € X, and if {p,} converges to p and to p’, then p’ = p. 

(c) If{p,} converges, then {p,} is bounded. 

(d) IfE< X and if p is a limit point of E, then there is a sequence {p,} in E 
such that p = lim p,. 


no 


Proof (c) Suppose p,-—p and let V be a neighborhood of p. For 
some ¢ >0, the conditions d(g, p) < «,qe X imply qe V. Correspond- 
ing to this ¢, there exists N such that n > N implies d(p,, p) <«. Thus 
n > N implies p, € V. 

Conversely, suppose every neighborhood of p contains all but 
finitely many of the p,. Fix e > 0, and let V be the set of all g € X¥ such 
that d(p.q) < «. By assumption, there exists N (corresponding to this V) 
such that p,¢V if n>N. Thus d(p,, p)<e if n>=>N; hence p, —>p. 
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(b) Let e>O0 be given. There exist integers NV, N’ such that 


n>wN_ implies d(p,, p) < => 


n>N’ implies d(p,,p’)< = 
Hence if m > max (N, N’), we have 


A(p, p’) < Up, p,) + Ap, p’) < &. 


Since ¢ was arbitrary, we conclude that d(p, p’) = 0. 
(c) Suppose p, >p. There is an integer N such that n>WN 
implies d(p,.p) <1. Put 


r= max {La(pi, p), .... 4lPy. Pp}. 


meme, py=rforn=1,2,3;.... 

(¢) For each positive integer n, there is a point p, € E such that 
d(p,,p)<1/n. Given e>0, choose N so that Ne>J!. If n>WQN, it 
follows that d(p,, p) < «. Hence p, — p. 

This completes the proof. 


For sequences in R* we can study the relation between convergence, on 
the one hand, and the algebraic operations on the other. We first consider 
sequences of complex numbers. 


3.3. Theorem Suppose {s,}, {t,} are complex sequences, and lim,.., 5, = S, 
Moe t, = 1. THEn 


(a) lim(s, + 74,)=5 +6; 


Ul feed 1 = 

(6) limes, = cs, lim (c + 5,) = c+ 8, for any number c: 
[ee? 6 no 

(cj lines, t,, = st; 
n> oc 


i» ] 
(7) lim—=-, provided s, #0 (n =1, 2, 3,...), ands 4 0. 
5 


n> © Ay 
Proof 


(a) Given e > 0, there exist integers N,, N, such that 


€ 
n>WN,_ implies Is, — 5] <5, 


te 
n>WN,_ implies aan | 5 - 
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If N = max (N,, N;), then n => N implies 
i(S, + tn) —(8 +0] < |s,-—s| + |t,-—t| <e. 
This proves (a). The proof of (5) is trivial. 
(c) We use the identity 
(1) Sif, — St =(S, — S(t, — t) + s(t, — t) + t(s, — 5). 
Given ¢ > 0, there are integers N,, NV, such that 
n>WN, implies |s,—s| < /e, 
n>N, implies |1,—t| </e. 
If we take N = max (N,, N,), n > N implies 
Ln — Sit) | cag, 
so that 


lim (s, — s)(t, — t) = 0. 


We now apply (a) and (db) to (1), and conclude that 


lim (s,f, — St) = 0. 


n—- DD 


(d) Choosing m such that |s, —s| <4|s| if m >m, we see that 
Is.] >41s| (2am). 
Given ¢ > 0, there,is an integer N > m such that n > N implies 
| 5, =| = 4|s|7e. 
Hence, for n > N, 


5S, —S 


a — — — al a 
Sas. jz | 


3.4 Theorem 


(a) Suppose x, € R* (n =1, 2, 3,...) and 


= (inune ae ita) 
Then {x,,} converges to x = (a,,..., &) if and only if 
(2) lim o;,, = &; (l<j<k). 


no 
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(b) Suppose {x,}, {y,} are sequences in R*, {B,,} is a sequence of real numbers, 
and x, >x,y, ~Y, B, ~B. Then 


lim (x, + y,) =x +, lime, -yo= &-¥% lnm fx, =P. 
Proof 


(a) If x, —x, the inequalities 


| ox 


1 a aL, | < |x, y= ml, 
which follow immediately from the definition of the norm in R*“, show that 
(2) holds. 

Conversely, if (2) holds, then to each e >0 there corresponds an 
integer N such that n > N implies 


E 
ey,. “eal Se (1 <7 #&) 
/k 
Hence n > N implies 
k le 
|x, x| = 2, Me <€ 
j=! 


so that x, ~x. This proves (a). 
Part (b) follows from (a) and Theorem 3.3. 


SUBSEQUENCES 


3.5 Definition Given a sequence {p,}, consider a sequence {n,} of positive 


integers, such that m, <n, <n,<:-::. Then the sequence {p,.} is called a 
subsequence of {p,}. If {p,,} converges, its limit is called a subsequential limit 
of {p,}. 


It is clear that {p,} converges to p if and only if every subsequence of 


{p,} converges to p. We leave the details of the proof to the reader. 


3.6 Theorem 


(a) If {p,} is a sequence in a compact metric space X, then some sub- 
sequence of {p,} converges to a point of X. 
(b) Every bounded sequence in R* contains a convergent subsequence. 
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Proof 


(a) Let E be the range of {p,}. If £ is finite then there is a pe E and a 
sequence {n;} with ny <<, <n; <°:*, such that 


Page, = 


The subsequence {p,,,} so obtained converges evidently to p. 

If E is infinite, Theorem 2.37 snows that E has a limit point p € X. 
Choose n, so that d(p, p,,) < 1. Having chosen 7, ...,;-,, we see from 
Theorem 2.20 that there is an integer n; >n,_, such that d(p, p,,) < 1/i. 
Then {p,,} converges to p. 


(b) This follows from (a), since Theorem 2.41 implies that every bounded 
subset of R* lies in a compact subset of Rr. 


3.7. Theorem “The subsequential limits of a sequence {p,} in a metric space X 
form a closed subset of X. 


Proof Let E* be the set of all subsequential limits of {p,} and let g be a 
limit point of E*. We have to show that q € E*. 

Choose n, so that p,, #q. (If no such n, exists, then E* has only 
One point, and there is nothing to prove.) Put 6 = d(q, p,,). Suppose 
Ny, ....2;_, are-chosen. Since @ is a limit pomt of E*, there is an xe E* 
with d(x,q)<27'6. Since xe E*, there is an n;>n,;-, such that 
Ax p,.)<27'6. Pitas 


Aqspyys 


for i=1,2,3,.... This says that {p,} converges tog. Hence g € E”*. 


CAUCHY SEQUENCES 


3.8 Definition A sequence {p,} in a metric space X is said to be a Cauchy 
sequence if for every ¢ > O there is an integer N such that d(p,, p,,)<eifn>N 
and m2>N. 

In our discussion of Cauchy sequences, as well as in other situations 
which will arise later, the following geometric concept will be useful. 


3.9 Definition Let E be a subset of a metric space X, and let S be the set of 
all real numbers of the form d(p,q), with pe E and qe. The sup of Sis 
called the diameter of E. 
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If{p,}is a sequence in X and if Ey consists of the points py, Pyai,Pvizs---s 


it is clear from the two preceding definitions that {p,} is a Cauchy sequence 
if and only if 


lim diam Ey = 0. 


N-+o 


3.10 Theorem 


3.11 


(a) If E is the closure of a set E ina metric space X, then 

diam E = diam E. 
(b) If K, is a sequence of compact sets in X such that K,> K,., 
Grp 2e3;~yanad if 


lim diam K, = 0, 


then (\*K,, consists of exactly one point. 
Proof 
(a) Since Ec E, it is clear that 

diam E < diam E. 

Fix s > 0, and choose p € E,qg € F. By the definition of E, there are 
points p’,q’, in E such that d(p, p’) < €, d(q, q’) < &. Hence 
d(p,q) < Up, p’) + U(p' q’) + d(q’, g) 
<2¢ + d(p’,q') <2¢ + diam E. 


It follows that 
diam E < 2e + diam E, 


and since € was arbitrary, (a) is proved. 

(6) Put K=()\7K,. By Theorem 2.36, K is not empty. If K contains 
more than one point, then diam K > 0. But for each n. K, > K, so that 
diam K, > diam K. This contradicts the assumption that diam K, > 0. 


Theorem 


(a) Inany metric space X, every convergent sequence is a Cauchy sequence. 

(b) If X is a compact metric space and if {p,} is a Cauchy sequence in X, 
then {p,} converges to some point of X. 

(c) In R*, every Cauchy sequence converges. 


Note: The difference between the definition of convergence and 
the definition of a Cauchy sequence is that the limit is explicitly involved 
in the former, but not in the latter. Thus Theorem 3.11(6) may enable us 
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(3) 


3.12 


to decide whether or not a given sequence converges without knowledge 
of the limit to which it may converge. 

The fact (contained in Theorem 3.11) that a sequence converges in 
R* if and only if it is a Cauchy sequence is usually called the Cauchy 
criterion for convergence. 


Proof 


(a) If p,—p and if ¢ >0, there is an integer N such that d(p, p,) < € 
for alln > N. Hence 


Ap,» Pm) = d(p,,, p) + d(p, Pm) <72é 


as soon asm >Nandm2>N. Thus {p,} is a Cauchy sequence. 


(b) Let {p,} be a Cauchy sequence in the compact space X. For 
N= 1, 2,3, ..., let Ey be thewet consisting Of py, Pya,. Prea.----. 
Then 

lim diam E, = 0, 

Now 
by Definition 3.9 and Theorem 3.10(a). Being a closed subset of the 
compact space X, each Ey is compact (Theorem 2.35). Also Ey > Ey 4. 
sothat Ey >WEy,.1- 

Theorem 3.10(b) shows now that there is a unique p € X which lies 
in every Ey. 

Let e>0 be given. By (3) there is an integer Ny such that 
diam E, <e if N>WNo. Since pe Ey, it follows that d(p,q)<e for 
every ge Ey, hence for every ge Ey. In other words, d(p, p,) <« if 
n> No. This says precisely that p, — p. 


(c) Let {x,} be a Cauchy sequence in R*. Define Ey as in (6), with x; 
in place of p;. For some N, diam Ey <1. The range of {x,} is the union 
of Ey and the finite set4{x,,...,%,_~43. Hence {x,} 1 bounded, Sinee 
every bounded subset of R“ has compact closure in R* (Theorem 2.41), 
(c) follows from (5). 


Definition A metric space in which every Cauchy sequence converges 1s 


said to be complete. 


Thus Theorem 3.11 says that all compact metric spaces and all Euclidean 


spaces are complete. Theorem 3.11 implies also that every closed subset E of a 
complete metric space X is complete. (Every Cauchy sequence in E is a Cauchy 
sequence in X, hence it converges to some p € X, and actually p € E since E is 
closed.) An example of a metric space which is not complete is the space of all 
rational numbers, with d(x, y) = |x — y|. 
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Theorem 3.2(c) and example (d) of Definition 3.1 show that convergent 
sequences are bounded, but that bounded sequences in R* need not converge. 
However, there is one important case in which convergence is equivalent to 
boundedness; this happens for monotonic sequences in R’. 


3.13 Definition A sequence {s,} of real numbers is said to be 


(a) monotonically increasing ‘if s, < 5,4, (n = 1, 2, 3,...); 
(6) monotonically decreasing if s, > 5,4, (n= 1, 2, 3,...). 


The class of monotonic sequences consists of the increasing and the 
decreasing sequences. 


3.14 Theorem Suppose {s,} is monotonic. Then {s,\ converges if and only if it 
is bounded. 


Proof Suppose s, < 5,4, (the proof is analogous in the other case). 
Let E be the range of {s,}. If {s,} is bounded, let s be the least upper 
bound of E. Then 


SS la) vip a 
For every ¢ > 0, there is an integer N such that 
s—&<Sy<s, 


for otherwise s — € would be an upper bound of E. Since {s,} increases, 
n> N therefore implies 


S—E<5,<S, 


which shows that {s,} converges (to s). 
The converse follows from Theorem 3.2(c). 


UPPER AND LOWER LIMITS 


3.15 Definition Let {s,} be a sequence of real numbers with the following 
property: For every real M there is an integer N such that n> N implies 


S, = M. We then write 
Sq P20. 


Similarly, if for every real M there is an integer N such that n > N implies 
S, <= M, we write 


> — @. 
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It should be noted that we now use the symbol — (introduced in Defini- 
tion 3.1) for certain types of divergent sequences, as well as for convergent 
sequences, but that the definitions of convergence and of limit, given in Defini- 
tion 3.1, are in no way changed. 


3.16 Definition Let {s,} be a sequence of real numbers. Let E be the set of 
numbers x (in the extended real number system) such that s,, > x for some 
subsequence {5,,}. This set E contains all subsequential limits as defined in 
Definition 3.5, plus possibly the numbers +00, — oo. 

We now recall Definitions 1.8 and 1.23 and put 


s* = supre, 
Sx = inf E. 


The numbers s*, 5s, are called the upper and /ower limits of {s,}; we use the 
notation 
lim sup s, = s*, lim inf s, =-s. 
n-@ n—- 2 
3.17 Theorem Let {s,} be a sequence of real numbers. Let E and s* have the 
same meaning as in Definition 3.16. Then s* has the following two properties: 


@ «ct. 
(b) If x>s*, there is an integer N such that n> N implies s, < x. 


Moreover, s* is the only number with the properties (a) and (6). 


Of course, an analogous result is true for s,. 
Proof 


(a) Ifs* = +00, then E is not bounded above; hence {s,} is not bounded 
above, and there is a subsequence {5s,,} such that s,, — +00. 

If s* is real, then E is bounded above, and at least one subsequential 
limit exists, so that (a) follows from Theorems 3.7 and 2.28. 

If s* = —o, then E contains only one element, namely — oo, and 
there is no subsequential limit. Hence, for any real M, s, > M for at 
most a finite number of values of n, so that s, + — oo. 

This establishes (a) in all cases. 

(b) Suppose there is a number x >s* such that s, > x for infinitely 
many values of n. In that case, there is a number yeE such that 
y>x>s*, contradicting the definition of s*. 

Thus s* satisfies (a) and (5). 

To show the uniqueness, suppose there are two numbers, p and q, 
which satisfy (a) and (5), and suppose p < g. Choose x such that p < x <q. 
Since p satisfies (b), we have s, < x form = N. But then gq cannot satisfy (a). 
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3.18 Examples 


(a) Let {s,} be a sequence containing all rationals. Then every real 
number is a subsequential limit, and 


lim sup s, = +00, lim inf s, = — oo. 
(6) Lets, =(-—1"/{1 + (1/n)). Then 
lim sup s, = 1, lim inf s, = —1!. 


(c) Fora real-valued sequence {s,}, lim s, = 5 if and only if 
lim sup s, = lim inf s, = s. 


We close this section with a theorem which is useful, and whose proof is 
quite trivial: 


3.19 Theorem /fs, <1, forn>N, where N is fixed, then 


lim inf s, < lim inf f,, 


n- OO n~ oc 


lim sup s, < lim sup f,. 


avo a oc 


SOME SPECIAL SEQUENCES 


We shall now compute the limits of some sequences which occur frequently. 
The proofs will all be based on the following remark: IfO0 < x, <5, forn >= WN, 
where N is some fixed number, and if s, +0, then x, > 0. 


3.20 Theorem 
] 
(a) If p>O9, then lim he 0. 
(b) If p>, then lim 2/p = 1. 


(c) lim t/n=1. 


n 
7 li ————— a 
(d) If p>0 anda is real, then si (+p 


(e) If |x| <1, then lim x" =0. 


n- © 
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Proof 


(a) Take n >(I1/e)'/?. (Note that the archimedean property of the real 
number system is used here.) 
(6) If p>1, put x,=2/p—1. Then x,>0, and, by the binomial 
theorem, 

1 + nx, S(1 +x,)? =p, 
so that 


—l 
b<%, <= 
n 


Hence x, > 0. If p = 1, (6) is trivial, and if 0 < p < 1, the result is obtained 


by taking reciprocals. 
@ Patx, = v n—1. Then x, > 0, and, by the binomial theorem, 


Hence 


o<x< [2 ie 2): 


(2) Let k be an integer such that k >a,k >0. For n > 2k, 
n(n —1)-*-(n-—k +1) 1 PT 


(l+pyr>@p*= m7 a 
Hence 
n* Re... 
(i ao. * (n > 2k) 


Since « — k < 0, n*~* -+0, by (a). 
(e) Take « =0 in (d). 


SERIES 


In the remainder of this chapter, all sequences and series under consideration 
will be complex-valued, unless the contrary is explicitly stated. Extensions of 
some of the theorems which follow, to series with terms in R*, are mentioned 
in Exercise 15. 
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3.21 Definition Given a sequence {a,}, we use the notation 


q 


<a (psq) 


n=p 


to denote the sum a, + a,,,; +°*'+a4,. With {a,} we associate a sequence 
{s,}, where 


For {s,} we also use the symbolic expression 


Qa, + @ 4a, -*: 
Or, more concisely, 


(4) yay. 


The symbol (4) we call an infinite series, or just a series. The numbers 
s, are called the partial sums of the series. If {s,} converges to s, we say that 
the series converges, and write 


a 
, &,=% 
n=1 


The number s is called the sum of the series; but it should be clearly under- 
stood that s is the limit of a sequence of sums, and is not obtained simply by 
addition. 

If {s,} diverges, the series is said to diverge. 

Sometimes, for convenience of notation, we shall consider series of the 
form 


(5) 5 we. 


And frequently, when there is no possible ambiguity, or when the distinction 
is immaterial, we shall simply write La, in place of (4) or (5). 

It is clear that every theorem about sequences can be stated in terms of 
series (putting a, = 5,, and a, =s, —5,-, for n> 1), and vice versa. But it is 
nevertheless useful to consider both concepts. 

The Cauchy criterion (Theorem 3.11) can be restated in the following 
form: 


3.22 Theorem <a, converges if and only if for every & > 0 there is an integer 
N such that 


(6) 
ifmaen2N. 
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In particular, by taking m = n, (6) becomes 
lqul <6 (reap): 
In other words: 


3.23 Theorem If La, converges, then lim,.,, 4, = 9. 


The condition a, +0 is not, however, sufficient to ensure convergence 
of La,. For instance, the series 


n=1M 


diverges; for the proof we refer to Theorem 3.28. 


Theorem 3.14, concerning monotonic sequences, also has an immediate 
counterpart for series. 


3.24 Theorem 4 series of nonnegative’ terms converges if and only if its 
partial sums form a bounded sequence. 


We now turn to a convergence test of a different nature, the so-called 
“comparison test.” 


3.25 Theorem 


(a) If |\a,| <c, for n >No, where No is some fixed integer, and if Xc, 
converges, then La, converges. 
(6) Ifa,2>d,>0 forn > No, and if Xd, diverges, then Xa, diverges. 


Note that (b) applies only to series of nonnegative terms a,. 


Proof Given « > 0, there exists N > No such that m > n> N implies 


by the Cauchy criterion. Hence 


m 
d % 
k=n 


m m 
<)>) lal<>) ase, 
k=n k=n 


and (a) follows. 
Next, (5) follows from (a), for if La, converges, so must Ld, [note 
that (5) also follows from Theorem 3.24]. 


1 The expression *‘ nonnegative ’’ always refers to real numbers. 
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The comparison test is a very useful one; to use it efficiently, we have to 
become familiar with a number of series of nonnegative terms whose conver- 
gence or divergence is known. 


SERIES OF NONNEGATIVE TERMS 


The simplest of all is perhaps the geometric series. 


3.26 Theorem J[f0 <x <1, then 


If x => 1, the series diverges. 


Proaf ifxl, 


The result follows if we let n + 90. For x = 1, we get 
Fo 


which evidently diverges. 


In many cases which occur in applications, the terms of the series decrease 
monotonically. The following theorem of Cauchy is therefore of particular 
interest. The striking feature of the theorem is that a rather ‘“‘thin’’ subsequence 
of {a,} determines the convergence or divergence of Za,,. 


3.27 Theorem Suppose a, >a, >a;>°::>0. Then the series ) , a, con- 
verges if and only if the series 


(7) 3 Mas. = a, + 2a, + 4a, + 8ag+°°° 
k=0 
converges. 
Proof By Theorem 3.24, it suffices to consider boundedness of the 
partial sums. Let 
S,=@,+@,+°'' +4, 


ti, = Q, + Bao eervect Page: 
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For n < 2", 
Sy SA, + (Gz +3) + °° + (@ge + 7+ + GQues_) 
dy Yay t PD 
=ft,, 
so that 
(8) Syiete. 
On the other hand, if n > 2*, 
SiueeQs + a, + (a, + a4) + ‘is + (A x-144 i + Ax) 
> da, +a + Zags: 1 “oe 
ko 


so that 
(9) 2H, 


By (8) and (9), the sequences {s,} and {t,} are either both bounded 
or both unbounded. This completes the proof. 


I 
3.28 Theorem ) > converges if p > \ and diverges if p <1. 


Proof If p<0, divergence follows from Theorem 3.23. If p>0, 
Theorem 3.27 is applicable, and we are led to the series 


eo) i 00 
OP ain wes QC Pyke 
Pe pi oxo 
Now, 2'-? <1 if and only if 1 — p <0, and the result follows by com- 
parison with the geometric series (take x = 2'~” in Theorem 3.26). 

As a further application of Theorem 3.27, we prove: 


3.29 Theorem /fp>1, 


(10) —_ 


converges; if p < 1, the series diverges. 
Remark ‘‘log 7’ denotes the logarithm of ” to the base e (compare Exercise 7, 


Chap. 1); the number e will be defined in a moment (see Definition 3.30). We 
let the series start with m = 2, since log 1 = 0. 
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Proof The monotonicity of the logarithmic function (which will be 
discussed in more detail in Chap. 8) implies that {log n} increases. Hence 
{I/n log n} decreases, and we can apply Theorem 3.27 to (10); this 
leads us to the series 

I 2 I | >» | 


rl . ok oo —_—_—_—_————= 1 = a ———  —————— —, 
( ) i 2*(log 2*)P = (k log 2° (log 2? z. kP 
and Theorem 3.29 follows from Theorem 3.28. 


This procedure may evidently be continued. For instance, 
EY I 
n=3 logn log log n 


(12) 


diverges, whereas 
20 1 


(13) Sonleg atagllas ay? 


converges. 


We may now observe that the terms of the series (12) differ very little 
from those of (13). Still, one diverges, the other converges. If we continue the 
process which led us from Theorem 3.28 to Theorem 3.29, and then to (12) and 
(13), we get pairs of convergent and divergent series whose terms differ even 
less than those of (12) and (13). One might thus be led to the conjecture that 
there is a limiting situation of some sort, a ‘“‘boundary”’ with all convergent 
series On one side, all divergent series on the other side—at least as far as series 
with monotonic coefficients are concerned. This notion of “‘boundary”’ is of 
course quite vague. The point we wish to make 1s this: No matter how we make 
this notion precise, the conjecture is false. Exercises 11(b) and 12(b) may serve 
as illustrations. 

We do not wish to go any deeper into this aspect of convergence theory, 
and refer the reader to Knopp’s ‘“‘Theory and Application of Infinite Series,” 
Chap. IX, particularly Sec. 41. 


THE NUMBER e 
e | 
3.30 Definition e = _ 


naon! 


Here nt=1-2-3---nifn>1, and 0!='1. 
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Since 
= | Sorte a Seta 
— i ae 2. [>> omy, 
1 1 1 
<l+l4+ 5 +a3+ tae 


the series converges, and the definition makes sense. In fact, the series converges 
very rapidly and allows us to compute e with great accuracy. | 

It is of interest to note that e can also be defined by means of another 
limit process; the proof provides a good illustration of operations with limits: 


] n 
3.31 Theorem lim (: 4 -) = 


n~ oO 


Proof Let 


Hence ¢, <5,, so that 
(14) | lim sup ¢, < e, 


no 


by Theorem 3.19. Next, if n > m, 


] 1 - 
hetei+s(1-)4-- +o (1-2 oe : 
z= n m! n n 


Let n > co, keeping m fixed. We get 


— I 
liminff,>1+1+—+4+::-+—, 
nen 2! 
so that 
S, < lim inf f,. 
n~> x 


Letting m — 00, we finally get 


(15) e <lim inf 1,. 


LY Saoaes'9 6 


The theorem follows from (14) and (15). 
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= : : l 
The rapidity with which the series ) — converges can be estimated as 
n\ 


follows: If s, has the same meaning as above, we have 


] 1 J 


=. = tt Sa eae 
+ @el! @42! Gry 
< 1+ ~ eon ae 
(n+ 1)! n+1  (n+1)? {nin 
so that 
1 
(16) 0<e-—5s,<—-: 
n'n 


Thus 5,9, for instance, approximates e with an error less than 1077. The 
inequality (16) is of theoretical interest as well, since it enables us to prove the 
irrationality of e very easily. 


3.32 Theorem e is irrational. 


Proof Suppose e is rational. Then e = p/g, where p and g are positive 
integers. By (16), 


l 
By our assumption, qg!e is an integer. Since 


1 I 
a's, =44(1 tlt st t5] 


is an integer, we see that g!(e — s,) is an integer. 
Since q > 1, (17) implies the existence of an integer between 0 and 1. 
We have thus reached a contradiction. 


Actually, e is not even an algebraic number. For a simple proof of this, 
see page 25 of Niven’s book, or page 176 of Herstein’s, cited in the Bibliography. 


THE ROOT AND RATIO TESTS 
3.33 Theorem (Root Test) Giren La,, put « = lim sup i la,|. 
Then 


(a) ifa<1, La, converges; 
(b) ifa>1, La, diverges; 
(c) ifa=1, the test gives no information. 
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3.34 


Proof If «<1, we can choose f so that a < 6B <1, and an integer N 


such that 
V/\a,| <B 
for n > N [by Theorem 3.17(5)]. That is, n > N implies 


|a,| <p”. 


Since 0 < B <1, Lf” converges. Convergence of La, follows now from 
the comparison test. 

If « > 1, then, again by Theorem 3.17, there is a sequence {n,} such 
that 


m/ |a,,| >. 
Hence |a,| >1 for infinitely many values of n, so that the condition 


a, ~0, necessary for convergence of La,, does not hold (Theorem 3.23). 
To prove (c), we consider the series 


E-. D- 
n —n? 
For each of these series « = 1, but the first diverges, the second converges. 


Theorem (Ratio Test) The series La, 


Qn+1 


(a) converges if lim sup al 


noo 


Qn+1 
a, 


(b) diverges if > 1 forn >No, where no is some fixed integer. 


Proof If condition (a) holds, we can find f < 1, and an integer N, such 
that 


forn > WN. In particular, 


laya1| < Blay|, 
lay+2| < Blays,| < B* |ay], 


lay +pl < B? | ay]. 
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That is, 
|a, | = |ay|B-™ : B" 


for n > N, and (a) follows from the comparison test, since £8" converges. 
If |a,4,| = |a,| form = no, it is easily seen that the condition a, +0 
does not hold, and (4) follows. 


Note: The knowledge that lima,,,/a,=1 implies nothing about the 
convergence of La,. The series £1/n and £1/n? demonstrate this. 
3.35 Examples 

(a) Consider the series 


| 1 1 1 l 1 i} 
stat gate tat et at at vane 


2 - 3 
for which 
lim inf 22! = lim (5) = 0, 
name Ginmenaeda 
lim inf 2/a, = lim” sz 
nw na \ 3” J3 
1 


i a/q = i ee 
Sp cae ta 


3 a 
lim sup = lim (5) = +00. 


The root test indicates convergence; the ratio test does not apply. 
(b) The same is true for the series 


eS a a res 
2 S$ «f° S2eel6 128 & ; 
where 
tim inf 24 =, 
n-* 0c a, 8 
° Gn+1 
litensup 2 = 2, 
but 


lim 2/a, = 4. 
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3.36 Remarks The ratio test is frequently easier to apply than the root test, 
since it is usually easier to compute ratios than nth roots. However, the root 
test has wider scope. More precisely: Whenever the ratio test shows conver- 
gence, the root test does too; whenever the root test is inconclusive, the ratio 
test is too. This is a consequence of Theorem 3.37, and is illustrated by the 
above examples. 

Neither of the two tests is subtle with regard to divergence. Both deduce 
divergence from the fact that a, does not tend to zero as n > 00. 


3.37 Theorem or any sequence {c,} of positive numbers, 


Cn+t 


lim inf 


n— 00 n 


< lim inf /c,, 


no 


Cn+1 


lim sup i < lim sup — 


n~@ no n 


Proof We shall prove the second inequality; the proof of the first is 
quite similar. Put 


Cat 
« = lim sup——- 
noo Ch 


If « = +00, there is nothing to prove. If « is finite, choose 8 > «. There 
is an integer N such that 


forn=>WN. In particular, for any p > 0, 
Cyent1 S Beyee (K =0,1,....9p — 1). 
Multiplying these inequalities, we obtain 


Cn+p <s Bey, 


or 
csc ph ap (GSN 
Hence 
Cu Sena “8, 
so that 
(18) lim sup wen < B, 


n-> oO 
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by Theorem 3.20(5). Since (18) is true for every B > a, we have 
lim sup “lc, <a. 


aro 


POWER SERIES 


3.38 Definition Given a sequence {c,} of complex numbers, the series 
(19) > ca" 
n=0 


is called a power series. The numbers c, are called the coefficients of the series; 
z is a complex number. 

In general, the series will converge or diverge, depending on the choice 
of z. More specifically, with every power series there is associated a circle, the 
circle of convergence, such that (19) converges if z is in the interior of the circle 
and diverges if z is in the exterior (to cover all cases, we have to consider the 
plane as the interior of a circle of infinite radius, and a point as a circle of radius 
zero). The behavior on the circle of convergence is much more varied and can- 
not be described so simply. 


3.39 Theorem Given the power series Xc,,z", put 


] 
cmelima apes | Cals R= 


Ufa=0, R= +0;ifa= +0, R=0.) Then Xc,2" converges if \z| < R, and 
diverges if \z| > R. 


Proof Put a, =c,z", and apply the root test: 


. — —  |2| 
lim sup .7/ |a,| = |z| lim sup ./ |c,| i ul 
n—7~o@ n- oO 


Note: R is called the radius of convergence of 2c, 2”. 


3.40 Examples 
(a) The series £n"z" has R = 0. 


oe : ' ; 
(6) The series *:_ has R = +o. (In this case the ratio test 1s easier to 
nN: 


apply than the root test.) 
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(c) The series Xz” has R=1. If |z| =1, the series diverges, since {z”} 

does not tend to 0 as n> 00. 

(d) The series ae has R=1. It diverges if z= 1. It converges for all 
n 

other z with |z| =1. (The last assertion will be proved in Theorem 3.44.) 


(e) The series ee has R=1. It converges for all z with |z| =1, by 
n 


the comparison test, since |z"/n?| = 1/n?. 


SUMMATION BY PARTS 


3.41 Theorem Given two sequences {a,}, {b,}, put 


A,=) a, 
k=0 
ifn >0; put A_, =0. Then, if0 < p <q, we have 


q q—1 
(20) > a, b, = om A,(b, = bias) + A,b, = A ile. 
n= =p 


p n 


Proof 


q q q q-1 
> ayb, = ¥ (A, — Aga) by = DR 3 Ay Digs 
n=p n=p n=p 


n=p-1 


and the last expression on the right is clearly equal to the right side of 
(20). 


Formula (20), the so-called ‘‘partial summation formula,” is useful in the 
investigation of series of the form La, b,, particularly when {b,} is monotonic. 
We shall now give applications. 


3.42 Theorem Suppose 


(a) the partial sums A, of Xa, form a bounded sequence; 
(b) by), bee; 
(c) limb, = 0. 


na 


Then Xa,,b, converges. 


3.43 
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Proof Choose M such that |A,| < M for all n. Given ¢ > 0, there is an 
integer NV such that by < (e/2M). For N < p <q, we have 


q 
>, an by, 
n=p 


q-1 
Y Ab, — Dae) + A,b, joa A,_,6, 
n=p 


<M 


q-1 
de a by+1) + b, + b, 


= 2Mb, < 2Mby = Ei. 


Convergence now follows from the Cauchy criterion. We note that the 
first inequality in the above chain depends of course on the fact that 
b, — ba+1 = 0. 


Theorem Suppose 


len) ele, | = ics] = -*:; 
(b) C2m-1 > 0, Com <0 (m = L pa 3 ey 
(2) li... Ca v- 


Then Xc,, converges. 


Series for which (5) holds are called ‘‘alternating series’; the theorem was 


known to Leibnitz. 


3.44 


Proof Apply Theorem 3.42, with a, = (—1)"*’, 5, = |c,|. 


Theorem Suppose the radius of convergence of Xc,z" is 1, and suppose 


Cobc, 2c, >, lim, c, =O Then &c,2" convengeswat everyspemteonsthe 
circle |z| = 1, except possibly at z =1. 


Proof Put a, =z", b,=c,. The hypotheses of Theorem 3.42 are then 
satisfied, since 


|A,| = 


if |z| =1,z41. 


ABSOLUTE CONVERGENCE 


The series La, is said to converge absolutely if the series £|a,| converges. 


3.45 Theorem I/f La, converges absolutely, then La, converges. 
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Proof The assertion foilows from the inequality 


m m 
> % = ECAP 
k=n n=k 


plus the Cauchy criterion. 


3.46 Remarks For series of positive terms, absolute convergence is the same 
as convergence. 

If La, converges, but X]a,| diverges, we say that La, converges non- 
absolutely. For instance, the series 


—1)" 
y | ) 


n 


converges nonabsolutely (Theorem 3.43). 

The comparison test, as well as the root and ratio tests, is really a test for 
absolute convergence, and therefore cannot give any information about non- 
absolutely convergent series. Summation by parts can sometimes be used to 
handle the latter. In particular, power series converge absolutely in the interior 
of the circle of convergence. 

We shall see that we may operate with absolutely convergent series very 
much as with finite sums. We may multiply them term by term and we may 
change the order in which the additions are carried out, without affecting the 
sum of the series. But for nonabsolutely convergent series this is no longer true, 
and more care has to be taken when dealing with them. 


ADDITION AND MULTIPLICATION OF SERIES 
3.47 Theorem If Ya,=A, and Xb,=B, then Ya,+b,)=A+B, and 
xca, = CA, for any fixed c. 

Proof Let 


A,= > a, B,=) b,. 
=0 k=0 
Then 


n 


A, + BR = > (a +,). 


k=0 


Since lim,..,, 4, = A and lim,..,, B, = B, we see that 


lim (A, + B,) = A+B. 


n~ oa 


The proof of the second assertion is even simpler. 
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Thus two convergent series may be added term by term, and the result- 
ing series converges to the sum of the two series. The situation becomes more 
complicated when we consider multiplication of two series. To begin with, we 
have to detine the product. This can be done in several ways; we shall consider 
the so-called ‘““Cauchy product.” 


3.48 Definition Given La, and £b,, we put 


C, = F Oh, © 20,1, 2,2.) 
k=0 


and call &c, the product of the two given series. 

This definition may be motivated as follows. If we take two power 
series La, z" and Lb, 2", multiply them term by term, and collect terms contain- 
ing the same power of z, we get 


ie @) le @) 
> a,2"* ¥ b,2" = (ap + az + 4,27 + °*bo + bz + by 2? + -°°) 
=0) n= 
= Ag by + (ay by + a,b0)z + (Ao bp + a,b, + a bo)z? + °°: 


Cot zte,z7 t:°°. 


I 


Setting z = 1, we arrive at the above definition. 


3.49 Example If 


An =) %> B, =) b, Gy= Bic. 
k=0 k=0 k=0 
and A, ~ A, B, > B, then it is not at all clear that {C,} will converge to AB, 
since we do not have C, = A, B,. The dependence of {C,} on {A,} and {B,} 1s 
quite a complicated one (see the proof of Theorem 3.50). We shall now show 
that the product of two convergent series may actually diverge. 


The series 
S kal) l 1 l 
es ye aft 4 


converges (Theorem 3.43). We form the product of this series with itself and 
obtain 


er Gra Gana 
I I 


1 | 
(Ra aA at 
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so that 
n 1 
= —] r ——————SS 
=e J —k + Ik +1) 
Since , ‘7 ; 
(n-k+ k= (541) -G-k) <G +1). 
we have 


so that the condition c, +0, which is necessary for the convergence of ic,, is 
not satisfied. 


In view of the next theorem, due to Mertens, we note that we have here 
considered the product of two nonabsolutely convergent series. 


3.50 Theorem Suppose 


ire) 
(a) ) a, converges absolutely, 
n=0 


(b) > % = A, 
n=0 
(c) } 5,=8, 
n=0 
@ «=e, CodD 4a. 
k=0 
Then 
> ic, =aB 
n=0 


That is, the product of two convergent series converges, and to the right 
value, if at least one of the two series converges absolutely. 


Proof Put 


=a, Ae, s- 8 ee) ii 
k=0 k=0 
Then 
C, = 9 dg + (do by + abo) + -** + (ob, + ayb,-1 + °° + a, bo) 
= aoB, + a, _; +°s°+ a, Bo 
= ao(B + B,) + a,(B + B,-1) +--+: + 4,(B + Bo) 
— A,B go AB, + a;B,-1 mae; a,Bo | 
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Put 
% = ao 8B, + a;B,-1 aa * a a, Bo. 
We wish to show that C, > AB. Since A,B— AB, it suffices to 
show that 
(21) lim y, = 0. 
Put 
@= > lag! 
n=0 


[It is here that we use (a).] Let ¢ > 0 be given. By (c), 8, +0. Hence we 
can choose WN such that |8,| <e for m > N, in which case 


yal S Boat °°: FBya,ay] * Bweva,we, $+ °° + 8,40 
< |Boa, + -°: + Bya,-n| + 60. 
Keeping WN fixed, and letting n — 00, we get 


lim sup |y,| < ea, 


n+ © 


since a, +0 as k + oo. Since ¢ is arbitrary, (21) follows. 


Another question which may be asked is whether the series Xc,, if con- 
vergent, must have the sum AB. Abel showed that the answer is in the affirma- 
tive. 


3.51 Theorem I/f the series Xa,, Xb,, &c, converge to A, B, C, and 
C, = Ao 5, +°°' + 4,59, then C = AB. 


Here no assumption is made concerning absolute convergence. We shall 
give a simple proof (which depends on the continuity of power series) after 
Theorem 8.2. 


REARRANGEMENTS 


3.52 Definition Let {k,},n =1,2,3,..., be a sequence in which every 
positive integer appears once and only once (that is, {k,} is a 1-1 function from 
J to J, in the notation of Definition 2.2). Putting 


a, = a, Cpe", 2; dies) 


we say that La’ is a rearrangement of La,. 
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If {s,}, {5,} are the sequences of partial sums of La,, La, it is easily seen 
that, in general, these two sequences consist of entirely different numbers. 
We are thus led to the problem of determining under what conditions all 
rearrangements of a convergent series will converge and whether the sums are 
necessarily the same. 


3.53 Example Consider the convergent series 


(22) 1 — aca aie ie me: 
and one of its rearrangements 
(23) 1+ § — det £ ed — begets 


in which two positive terms are always followed by one negative. If s is the 
sum of (22), then 


s<1—}3+4=2. 
Since 
1 | | 


poe ta” 


for k > 1, we see that 545 <5s¢ <sg <-:-, where s, is nth partial sum of (23). 
Hence 


lim sup s, > s3 = 3, 


noo 


so that (23) certainly does not converge to s [we leave it to the reader to verify 
that (23) does, however, converge]. 
This example illustrates the following theorem, due to Riemann. 


3.54 Theorem Let Xa, be a series of real numbers which converges, but not 
absolutely. Suppose 
—-0o<a<fP<o. 


Then there exists a rearrangement Xa, with partial sums s,, such that 


(24) | limrinf sia, lim sup s; = B. 
Proof Let 
= | a,,| + a, | a,| a, 
Pr = a a (n= 1, 2, 3,...). 


(25) 
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Then Pp — Gn = Qn» Pn +n = |Qn|sPn 20,4, =0. The series Xp,, £9, 
must both diverge. 
For if both were convergent, then 
X(Pn + Gn) = ZI a,| 


would converge, contrary to hypothesis. Since 
N N N N 
o. a, = a (Pn =f, = i Pa — dX Qn> 


divergence of Xp, and convergence of Lg, (or vice versa) implies diver- 
gence of La, again contrary to hypothesis. 

Now let P,, P,, P;,... denote the nonnegative terms of La,, in the 
order in which they occur, and let Q,, Q,, Q;,... be the absolute values 
of the negative terms of La,, also in their original order. 

The series 2P,, XQ, differ from Lp,, Lg, only by zero terms, and 
are therefore divergent. 

We shall construct sequences {7}, {k,}, such that the series 


co ae = QO) = °°? = Qe + Bags +: 
Ae es Mei a 


which clearly is a rearrangement of La,,, satisfies (24). 

Choose real-valued sequences {a,}, {B,} such that «,>a, B,— 8, 
a,, = Pa ’ By = 0. 

Let m,, k, be the smallest integers such that 


Pa ot ta 
a ee ee ee 
let m,,k, be the smallest integers such that 


ie a Oe ee ae oes ee 
Py tet? + Puy, — 1-79 — Oe, + Pyar tot t Ping — Dees 

Som= QO, Say: 
and continue in this way. This is possible since LP, and XQ, diverge. 


If x,, ¥, denote the partial sums of (25) whose last terms are P,, , 
— ©, , then 


|x, — Bl SF ee \¥n — Ln} < Ox, 


Since P, ~0 and QO, ~0 asn— o, we see that x, > B, y, 74. 
Finally, it is clear that no number less than « or greater than f can 
be a subsequential limit of the partial sums of (25). 
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3.55 Theorem /f <a, is a series of complex numbers which converges absolutely, 
then every rearrangement of Xa, converges, and the~ all converge to the same sum. 


Proof Let La‘ be a rearrangement, with partial sums s,. Given ¢ > 0, 
there exists an integer N such that m >n > N implies 


(26) 5 |a;| <e. 


Now choose p such that the integers 1, 2,..., N are all contained in the 
set k,,k,,...,k, (we use the notation of Definition 3.52). Then if n > p, 
the numbers a,,..., a, will cancel in the difference s,—s,, so that 
|s, — S,| <6, by (26). Hence {s,} converges to the same sum as {s,}. 


EXERCISES 


1. Prove that convergence of {s,} implies convergence of {|s5,|}. Is the converse true? 
2. Calculate lim (Vn? + n— 7). 


Salt 6 — V2, and 
eee 24 V/s, (ed 293,. 3) 5 


prove that {s,} converges, and that s,2 for < n=1,2,3,.... 
4. Find the upper and iower limits of the sequence {s,} defined by 


Sam-1 
Ss, = 03 aa a Sam+1 = 5 + Sam. 


5. For any two real sequences {a,}, {b,}, prove that 


lin’ sup (a, + 5,) < lim sup a, + lim sup 3,, 


n-+@ n-- oO n—-~-@ 


provided the sum on the right is not of the form oo — oo. 
6. Investigate the behavior (convergence or divergence) of La, if 
(a) a, =Vn+1—Vn; 
yen = ii Sadan 
n 


(c) a, =(Wn— 1)"; 


1 
(d) a, = lane" for complex values of z. 
7. Prove that the convergence of Za, implies the convergence of 
Vay 
cae 


if a, >0. 


10. 


tk 


12. 
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. If Xa, converges, and if {5,} is monotonic and bounded, prove that La, 5, con- 


verges. 


. Find the radius of convergence of each of the following power series: 


2" 
(a) & nz" (6) Dz" 


= n 
(c) pe rae (d) 2302”. 


Suppose that the coefficients of the power series > a, z" are integers, infinitely many 
of which are distinct from zero. Prove that the radius of convergence is at most 1. 
Suppose:a, > 0, s, =a, + °°: + a,, and La, diverges. 


an 


(a) Prove that >° rT 7, diverges. 

(b) Prove that 
Qn +1 a... {ae >1 oS Sn 
Sy +1 SN+k Sn +k 


and deduce that >- = diverges. 


(c) Prove that 


An 
and deduce that >> <2 CONVETBES. 


(d) What can be said about 


an 


an 
_ ll Cg I 8) 
_ and > 


ea 


Zz 


Suppose a, > 0 and La, converges. Put 


(a) Prove that 


if m <n, and deduce that >> an diverges. 
iG 
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(b) Prove that 


an 


Vr 


201 Ki — WV eecees) 


An 
and deduce that >> V7 converses. 
rn 


13. Prove that the Cauchy product of two absolutely convergent series converges 
absolutely. 
14. If {s,} is a complex sequence, define its arithmetic means ca, by 


__ Soar rss 


en, 1); 2, 2n.). 
Pe as | (n at ad ) 


(a) If lim s, =s, prove that lim o, = s. 

(b) Construct a sequence {s,} which does not converge, although lim o, = 0. 

(c) Canit happen thats, > 0 forall and that lim sup s, = ©, although lim o, = 0? 
(d) Put a, = 5, — 5,-1, for n > 1. Show that 


] n 
A Cn — re k A 
Sn — 0 Para ak 


Assume that lim (a,) =0 and that {c,} converges. Prove that {s,} converges. 
{This gives a converse of (a), but under the additional assumption that na, — 0.] 
(e) Derive the last conclusion from a weaker hypothesis: Assume M < 0, 
|na,| <M for all n, and lim o, =o. Prove that lim s, =o, by completing the 
following outline: 
If m <n, then 
m+ 1 


Sy — Op = 
n 


1 n 
= mats — Om) + _— au (ss — $;). 


For these /, 


(n—i)M _(n—m—1)M 


1 < 
ise — Si a a acel 


Fix € > 0 and associate with each n the integer m that satisfies 


7] te m A 


Then (m + 1)/(n — m) < 1/e and |s,—s,;| < Me. Hence 


lim sup|s,— o| <Me. 


Since € was arbitrary, lim s, = o. 


15. 


16. 


ie 


18. 


19% 
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Definition 3.21 can be extended to the case in which the a, lie in some fixed R*. 
Absolute convergence is defined as convergence of X|a,|. Show that Theorems 
3.22, 3:23, 3:2 a), 3.33, 2:34, 3.42; 3246, 3247,..and 3.5S are tiewin thisemore 
general setting. (Only slight modifications are required in any of the proofs.) 


Fix a positive number «. Choose x, > Va, and define x, v3, xa, ..., by the 


recursion formula 
| a 
Xana =a XAn + ae | 
2 Xi, 


(a) Prove that {x,} decreases monotonically and that lim x, = V x. 
(b) Put €, =X, — Va, and show that 


2 2 
[3 & 


n 


2% n = swe 


En+1 = 


so that, setting 8 = 2V a, 


€; 


ens <8 (3) (eat 2. 35-...). 


(c) This is a good algorithm for computing square roots. since the recursion 
formula is simple and the convergence is extremely rapid. For example, if « = 3 


and x, = 2, show that e,/B < 54, and that therefore 


es 4 FO, Sa ie 
Fix a > 1. Take x, > Va, and define 


2 
a+ Xn 


a a me Bi + NX, 

(a) Prove that x; >x3 > Vs >°° 

(b) Prove that x, < x4 <x, <"' 

(c) Prove that lim x, = Va. 

(d) Compare the rapidity of convergence of this process with the one described 
in Exercise 16. 

Replace the recursion formula of Exercise 16 by 


Xn+1 == 


P 


where p is a fixed positive integer, and describe the behavior of the resulting 


sequences {x,}. 
Associate to each sequence a = {a,}, in which «, is 0 or 2, the real number 


a= b=. 


Prove that the set of all x(a) is precisely the Cantor set described in Sec. 2.44. 


21. 


22. 


25. 
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. Suppose {p,} is a Cauchy sequence in a metric space X, and some subsequence 


{pn,} converges to a point p€ X. Prove that the full sequence {p,} converges to p. 
Prove the following analogue of Theorem 3.10(b): If {E,} is a sequence of closed 
and bounded sets in a complete metric space X, if E, > E,+1, and if 

lim diam E, = 0, 


n-* 0 


then () PE, consists of exactly one point. 

Suppose X is a complete metric space, and {G,} is a sequence of dense open 
subsets of XY. Prove Baire’s theorem, namely, that ()2G, is not empty. (In fact, 
it is dense in X.) Hint: Find a shrinking sequence of neighborhoods E, such 
that E, < G,, and apply Exercise 21. 


. Suppose {p,} and {q,} are Cauchy sequences in a metric space X. Show that the 


sequence {d(p,,q,)} converges. Hint: For any m, n, 
A(Dns Gn) <A(Dn, Pm) + A(Pm, Gm) + A(Gm 5 Jn); 
it follows that 
|d(Dn, Qn) — d(Pm, Im)! 
is small if m and n are large. 


. Let X be a metric space. 


(a) Call two Cauchy sequences {p,}, {qn} in X equivalent if 
lim:@(p,, ,.gu) = 0. 


n- 2 


Prove that this is an equivalence relation. 
(b) Let X* be the set of all equivalence classes so obtained. If Pe X*, Qe X*, 
{p..} € P, {qn} € Q, define 


a0 


by Exercise 23, this limit exists. Show that the number A(P, Q) is unchanged if 
{pn} and {g,} are replaced by equivalent sequences, and hence that A is a distance 
function in X*. 

(c) Prove that the resulting metric space X* is complete. 

(d) For each pe X, there is a Cauchy sequence all of whose terms are p; let P, 
be the element of X* which contains this sequence. Prove that 


AGP ing P,) = d(p, q) 


for all p,q ¢ X. In other words, the mapping 9 defined by g(p) = P, is an isometry 
(i.e., a distance-preserving mapping) of X into X*. 

(e) Prove that p(X) is dense in X*, and that p(X) = X* if X is complete. By (d), 
we may identify X and p(X) and thus regard X as embedded in the complete 
metric space X¥*. We call X* the completion of X. 

Let X be the metric space whose points are the rational numbers, with the metric 
d(x, y) =|x— y|. What is the completion of this space? (Compare Exercise 24.) 


4 


CONTINUITY 


The function concept and some of the related terminology were introduced in 
Definitions 2.1 and 2.2. Although we shall (in later chapters) be mainly interested 
in real and complex functions (i.e., in functions whose values are real or complex 
numbers) we shall also discuss vector-valued functions (i.e., functions with 
values in R*) and functions with values in an arbitrary metric space. The theo- 
rems we shall discuss in this general setting would not become any easier if we 
restricted ourselves to real functions, for instance, and it actually simplifies and 
clarifies the picture to discard unnecessary hypotheses and to state and prove 
theorems in an appropriately general context. 

The domains of definition of our functions will also be metric spaces, 
suitably specialized in various instances. 


LIMITS OF FUNCTIONS 


4.1 Definition Let XY and Y be metric spaces; suppose E < X, f maps E into 
Y, and p is a limit point of E. We write f(x) > q as x > p, or 


(1) lim f(x) =4 


xp 
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if there is a point ge Y with the following property: For every ¢ >0 there 
exists a 6 > 0 such that 


(2) dy(f(x), q) ae 2 
for all points x € E for which 
(3) 0< d(x, P) <o. 


The symbols d, and dy refer to the distances in X and Y, respectively. 

If X and/or Y are replaced by the real line, the complex plane, or by some 
euclidean space R*, the distances d, , dy are of course replaced by absolute values, 
or by appropriate norms (see Sec. 2.16). 

It should be noted that pe X, but that p need not be a point of E 
in the above definition. Moreover, even if pé E, we may very well have 
f(p) # lim, .) $0). 


We can recast this definition in terms of limits of sequences: 


4.2 Theorem Let X, Y, E, f, and p be as in Definition 4.1. Then 


(4) lim f(x) =4 
if and only if 
(5) lim f(p,) =4 


for every sequence {p,\ in E such that 


(6) Pr#P, lim p, =p. 
Proof Suppose (4) holds. Choose {p,} in E satisfying (6). Let e>0 
be given. Then there exists 6>0 such that d,(f(x),q)<e if xeE 
and 0 <d,(x, p)<6. Also, there exists N such that n>N implies 
0<d,(p,,p)<06. Thus, for n>WN, we have d,(f(p,),q) < &, which 
shows that (5) holds. 

Conversely, suppose (4) is false. Then there exists some ¢ > 0 such 
that for every 6 > 0 there exists a point x e E (depending on 6), for which 
dy( f(x), gq) = € but 0 < d(x, p) < 6. Taking 6, = 1/n(n = 1, 2, 3,...), we 
thus find a sequence in E satisfying (6) for which (5) is false. 


Corollary Jf f has a limit at p, this limit is unique. 


This follows from Theorems 3.2(b) and 4.2. 
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4.3 Definition Suppose we have two complex functions, fand g, both defined 
on E. By f+g we mean the function which assigns to each point x of E the 
number f(x) + g(x). Similarly we define the difference f—g, the product fg, 
and the quotient //g of the two functions, with the understanding that the quo- 
tient is defined only at those points x of E at which g(x) #0. If f assigns to each 
point x of E the same number c, then / is said to be a constant function, or 
simply a constant, and we write f=c. If f and g are real functions, and if 
f(x) => g(x) for every x € E, we shall sometimes write f> g, for brevity. 
Similarly, if f and g map E into R“, we define f + g and f: g by 


(f+ g)(x) =f) + e(x), = (ff: g(x) = F(x) + a(x); 
and if A is a real number, (/f)(x) = Af(x). 


4.4 Theorem Suppose E < X, a metric space, p is a limit point of E, f and g 
are complex functions on E, and 


lim f(x) =A, lim g(x) = B. 
xp 


Then (a) lim (f+ 9)(x)=A+B; 
(b) lim (fg)(x) = AB; 

(c) lim (- 

9g 


xp 
Proof In view of Theorem 4.2, these assertions follow immediately from 
the analogous properties of sequences (Theorem 3.3). 


Joo =4. if B40. 


Remark If f and g map E into R*, then (a) remains true, and (b) becomes 
(b') lim (f° g)(x) =A°B. 
x—p 


(Compare Theorem 3.4.) 


CONTINUOUS FUNCTIONS 


4.5 Definition Suppose X and Y are metric spaces, E < X, pe E, and f maps 
E into Y. Then f is said to be continuous at p if for every ¢ > O there exists a 
6 > 0 such that 

dy( f(x), f(p)) < & 


for all points x € E for which d,(x, p) < 6. 
If f is continuous at every point of E, then fis said to be continuous on E. 
It should be noted that f has to be defined at the point p in order to be 
continuous at p. (Compare this with the remark following Definition 4.1.) 
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If p is an isolated point of E, then our definition implies that every function 
f which has E as its domain of definition is continuous at p. For, no matter 
which ¢ > 0 we choose, we can pick 6 > 0 so that the only point x € E for which 
d(x, p) <6 is x =p; then 


dy(f(x), f(p)) =0 < . 
4.6 Theorem In the situation given in Definition 4.5, assume also that p is a 
limit point of E. Then f is continuous at p if and only if lim,.., f(x) =f(p). 


Proof This is clear if we compare Definitions 4.1 and 4.5. 


We now turn to compositions of functions. A brief statement of the 
following theorem is that a continuous function of a continuous function is 
continuous. 


4.7 Theorem Suppose X, Y, Z are metric spaces, E< X, f maps E into Y, g 
maps the range of f, {(E), into Z, and h is the mapping of E into Z defined by 


A(x) =g(f(x)) (xe E). 


If f is continuous at a point p € E and if g is continuous at the point f(p), then h is 
continuous at p. 


This function h is called the composition or the composite of fand g. The 
notation 


h=9°f 
is frequently used in this context. 


Proof Let ¢>0 be given. Since g is continuous at /(p), there exists 
n > 0 such that 


dz(9(y), 9(F(P))) < e if dy(y, f(p)) <n and ye f(E). 
Since fis continuous at p, there exists 6 > 0 such that 
dy( f(x), f(p)) <n if dy(x, p) < dand xe E. 
It follows that 


d (A(x), h(p)) = dz(g(f(x)), 9(F(p))) < € 


if d(x, p) <6 and xe E. Thus A is continuous at p. 
4.8 Theorem A mapping f of a metric space X into a metric space Y is con- 
tinuous on X if and only if f~'(V) is open in X for every open set V in Y. 


(Inverse images are defined in Definition 2.2.) This is a very useful charac- 
terization of continuity. 
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Proof Suppose fis continuous on X and V is an open set in Y. We have 
to show that every point of f~'(V) is an interior point of f~'(V). So, 
suppose pe X and /(p)e V. Since V is open, there exists € > 0 such that 
yeVif dy(f(p), y) < €; and since f is continuous at p, there exists 6 > 0 
such that dy( f(x), f(p)) < € if dy(x, p) <6. Thus xe f~'(V) as soon as 
Gtx, Duc 6: 

Conversely, suppose f~'(V) is open in X for every open set V in Y. 
Fix pe X and e > 0, let V be the set of all ye Y such that dy(y, f(p)) < «. 
Then V is open; hence f~'(V) is open; hence there exists 5 > 0 such that 
xef~ '(V)as soon as d,(p, x) < 6. But if xe f~'(V), then f(x) € V, so 
that dy(/(x), [(p)) < €. 

This completes the proof. 


Corollary A mapping f of a metric space X into a metric space Y is continuous if 
and only if f~'(C) is closed in X for every closed set C in Y. 


This follows from the theorem, since a set is closed if and only if its com- 


plement is open, and since f~'(E‘°) = [f~'(E)]° for every Ec Y. 


We now turn to complex-valued and vector-valued functions, and to 


functions defined on subsets of R*. 


4.9 Theorem Let f and g be complex continuous functions on a metric space X. 
Then f + 9, fg, and f/g are continuous on X. 


4.10 


(7) 


In the last case, we must of course assume that g(x) # 0, for all x e X. 
Proof At isolated points of X there is nothing to prove. At limit points, 


the statement follows from Theorems 4.4 and 4.6. 


Theorem 


(a) Let fi, ..., f, be real functions on a metric space X, and let f be the 
mapping of X into R* defined by 


f(x) = (A), ---.A0)) = (we X); 


then f is continuous if and only if each of the functions f,, ..., f, is continuous. 
(b) If f and g are continuous mappings of X into R*, then f + g andf-g 
are continuous on X. 


The functions f,, ..., 4, are called the components of f. Note that 
f + g is a mapping into R*, whereas f - g is a rea/ function on X. 


88 PRINCIPLES OF MATHEMATICAL ANALYSIS 


Proof Part (a) follows from the inequalities 
k t 
Fi) ~ F001 < Ife) —109| =[¥. fed —forl?} 


for; =1,..., k. Part (6) follows from (a) and Theorem 4.9. 


4.11 Examples If x,, ..., x, are the coordinates of the point xe R*, the 
functions @; defined by 
(8) P(x) = x; (x € R*) 


are continuous on R*, since the inequality 


|o(x) — dfy)| < |x —y| 


shows that we may take 6 = ¢ in Definition 4.5. The functions ¢; are sometimes 
called the coordinate functions. 
Repeated application of Theorem 4.9 then shows that every monomial 


(9) XD «XK 


where n,, ..., m, are nonnegative integers, is continuous on R*. The same is 
true of constant multiples of (9), since constants are evidently continuous. It 
follows that every polynomial P, given by 


(10) PE icy... (x € R*), 


is continuous on R*. Here the coefficients Cn,---n, are complex numbers, m,, ..., My 
are nonnegative integers, and the sum in (10) has finitely many terms. 
Furthermore, every rational function in x,,..., x,, that 1s, every quotient 
of two polynomials of the form (10), is continuous on R* wherever the denomi- 
nator is different from zero. 
From the triangle inequality one sees easily that 


(11) |W — lar] ff <ajae—ag| Gepuynendt). 


Hence the mapping x > |x| is a continuous real function on R*. 
If now f is a continuous mapping from a metric space X into R*, and if @ 


is defined on X by setting ¢(p) = |f(z)|, it follows, by Theorem 4.7, that ¢ is a 
continuous real function on X. 


4.12 Remark We defined the notion of continuity for functions defined on a 
subset E of a metric space X¥. However, the complement of E in X plays no 
role whatever in this definition (note that the situation was somewhat different 
for limits of functions). Accordingly, we lose nothing of interest by discarding 
the complement of the domain of f, This means that we may just as well talk 
only about continuous mappings of one metric space into another, rather than 
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of mappings of subsets. This simplifies statements and proofs of some theorems. 
We have already made use of this principle in Theorems 4.8 to 4.10, and will 
continue to do so in the following section on compactness. 


CONTINUITY AND COMPACTNESS 


4.13 Definition A mapping f of a set E into R* is said to be bounded if there is 
a real number M such that |f(x)| < M for all xe E. 


4.14 Theorem Suppose f is a continuous mapping of a compact metric space 
X into a metric space Y. Then f(X) is compact. 


Proof Let {V,} be an open cover of f(X). Since fis continuous, Theorem 
4.8 shows that each of the sets f~'(V,) is open. Since X is compact, 


there are finitely many indices, say a,,..., a,, such that 
(12) HRS (Vago AIP Ye f 

Since f(f~'(E)) ¢ E for every E < Y, (12) implies that 
(13) SCM sg, © o> ON 


This completes the proof. 


Note: We have used the relation f(f~‘(E)) c E. valid for Ec Y. If 
Ec X, then f~'(/(E)) > E; equality need not hold in either case. 
We shall now deduce some consequences of Theorem 4.14. 


4.15 Theorem /ff is a continuous mapping of a compact metric space X into 
R*, then {(X) is closed and bounded. Thus, f is bounded. 


This follows from Theorem 2.41. The result is particularly important 
when f Is real: 


4.16 Theorem Suppose f is a continuous real function on a compact metric 
space X, and 
(14) M = sup f(p), m= inf f(p). 

pex 


pex 


Then there exist points p,q«é X such that f{(p) = M and f(q) =m. 


The notation in (14) means that M is the least upper bound of the set of 
all numbers f(p), where p ranges over X, and that m is the greatest lower bound 
of this set of numbers. 
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The conclusion may also be stated as follows: There exist points p and q 
in X such that f(g) < f(x) <f(p) for all x € X; that is, f attains its maximum 
(at p) and its minimum (at q). 


Proof By Theorem 4.15, f(X) is a closed and bounded set of real num- 
bers; hence f(X ) contains 


M =sup/f(X) and We if fEX ). 
by Theorem 2.28. 


4.17 Theorem Suppose f is a continuous 1-1 mapping of a compact metric 
space X onto a metric space Y. Then the inverse mapping f—' defined on Y by 


f'f@)=x (MEX) 
is a continuous mapping of Y onto X. 


Proof Applying Theorem 4.8 to f~' in place of f, we see that it suffices 
to prove that f(V) is an open set in Y for every open set Vin X. Fix such 
a set V. 

The complement V° of V is closed in X, hence compact (Theorem 
2.35); hence f(V ‘) is a compact subset of Y (Theorem 4.14) and so is 
closed in Y (Theorem 2.34). Since fis one-to-one and onto, /(V) is the 
complement of f(V °). Hence f(V) is open. 


4.18 Definition Let fbe a mapping of a metric space X into a metric space Y. 
We say that fis uniformly continuous on X if for every ¢ > 0 there exists 6 > 0 
such that 


(15) dy(f(p), f(q)) < € 


for all p and q in X for which d,(p, q) < 6. 

Let us consider the differences between the concepts of continuity and of 
uniform continuity. First, uniform continuity is a property of a function on a 
set, whereas continuity can be defined at a single point. To ask whether a given 
function is uniformly continuous at a certain point is meaningless. Second, if 
f is continuous on X, then it is possible to find, for each e > 0 and for each 
point p of X,anumber 6 > 0 having the property specified in Definition 4.5. This 
6 depends on € and on p. If fis, however, uniformly continuous on_X, then it is 
possible, for each e > 0, to find one number 6 > 0 which will do for all points 
p of X. 

Evidently, every uniformly continuous function is continuous. That the 
two concepts are equivalent on compact sets follows from the next theorem. 
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4.19 Theorem Let f be a continuous mapping of a compact metric space X 
into a metric space Y. Then f is uniformly continuous on X. 


(16) 


(17) 


(18) 
(19) 


(20) 


Proof Let ¢ >0 be given. Since f is continuous, we can associate to 
each point pe X a positive number ¢(p) such that 


qe X,dy(p.4) < $(p) implies dy( fp), [()) <5 


Let J(p) be the set of all g € X for which 
Ax(P, 4) < 29(p). 


Since pe J(p), the collection of all sets J(p) is an-open cover of X; and 
since X is compact, there is a finite set of points p,,..., p, in X. such that 


X oJ (py) UV" UI (Py). 
We put 
= , min [P(p,), ca) G(P,,)). 


Then 6>0. (This is one point where the finiteness of the covering. in- 
herent in the definition of compactness. is essential. The minimum of a 
finite set of positive numbers is positive, whereas the inf of an infinite set 
of positive numbers may very well be 0.) 

Now let g and p be points of X, such that d,(p,q) < 0. By (18). there 
is an integer m, | < 1m <n, such that p €J(p,,); hence 


Ax(P; Pin) < 2P(Pm)s 
and we also have 
Ax(4. Pm) < Ax(P. 9) + Ax(Ps Pm) < 9 + 3P(Pm) S PP): 
Finally, (16) shows that therefore 
Af (P), L(G) S Ay(f(P), f(Pm)) + Fy L(Q) (Pind) < €- 
This completes the proof. 


An alternative proof is sketched in Exercise 10. 
We now proceed to show that compactness is essential in the hypotheses 


of Theorems 4.14, 4.15, 4.16, and 4.19. 


4.20 Theorem Let E he a noncompact set in R'. Then 


(a) there exists a continuous function on E which is not bounded; 
(b) there exists a continuous and bounded function on E which has no 


maximum. 
If, in addition, E is bounded, then 
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(21) 


(22) 


(23) 


(c) there exists a continuous function on E which is not uniformly 
continuous. 


Proof Suppose first that E is bounded, so that there exists a limit point 
X, of E which is not a point of E. Consider 


1 
f(x) = ——_ (xe E). 
x —Xpo 


This is continuous on E (Theorem 4.9), but evidently unbounded. To see 
that (21) is not uniformly continuous, let ¢ > 0 and 6 > O be arbitrary, and 
choose a point x € E such that |x — x9| <6. Taking ¢ close enough to 
X 9, we can then make the difference | f(t) — f(x)| greater than ¢, although 
|r — x| <6. Since this is true for every 6 > 0, fis not uniformly continu- 
ous on E. 


The function g given by 


G(x) = (xe E) 


is continuous on E, and is bounded, since 0 < g(x) < |. It is clear that 


sup g(x) =], 
xeE 


whereas g(x) < 1 for all xe E. Thus g has no maximum on E. 
Having proved the theorem for bounded sets E. let us now suppose 
that E is unbounded. Then f(x) = x establishes (a), whereas 


7) 


x 
h = 
== swe) 
establishes (5), since 
sup A(x) = 1 
xeE 


and f(x) < 1 for all x € E. 

Assertion (c) would be false if boundedness were omitted from the 
hypotheses. For, let E be the set of all integers. Then every function 
defined on E is uniformly continuous on E. To see this, we need merely 
take 6 < 1 in Definition 4.18. 


We conclude this section by showing that compactness is also essential in 


Theorem 4.17. 
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4.21 Example Let X be the half-open interval [0, 27) on the real line, and 
let f be the mapping of X onto the circle Y consisting of all points whose distance 
from the origin is 1, given by 


(24) Kt) — (Cos t, sin’ 7) (0 = 7 < 2h), 


The continuity of the trigonometric functions cosine and sine, as well as their 
periodicity properties, will be established in Chap. 8. These results show that 
f is a continuous I-1 mapping of X onto Y. 

However, the inverse mapping (which exists, since f is one-to-one and 
onto) fails to be continuous at the point (1, 0) = f(0). Of course, X is not com- 
pact in this example. (It may be of interest to observe that f~' fails to be 
continuous in spite of the fact that Y is compact!) 


CONTINUITY AND CONNECTEDNESS 


4.22 Theorem /f f is a continuous mapping of a metric space X into a metric 
space Y, and if E is a connected subset of X, then f(E) is connected. 


Proof Assume, on the contrary, that f(E) = A U B, where A and B are 
nonempty separated subsets of Y. PutG =E nf '(A), H=Eo f7'(B). 

Then E =G vu H, and neither G nor H is empty. 

Since A c A (the closure of A), we have G c f~ '(A); the latter set is 
closed, since f is continuous; hence G < f~'(A). It follows that f(G) < A. 
Since f(H) = B and A x B is empty, we conclude that G7 H is empty. 

The same argument shows that G 7 H is empty. Thus G and H are 
separated. This is impossible if E is connected. 


4.23 Theorem Let f be a continuous real function on the interval [a, b}. If 
(a) < f(b) and if c is a number such that f(a) < c < f(b), then there exists a 
point x € (a, b) such that f(x) =c. 


A similar result holds, of course, if f(a) > (6). Roughly speaking, the 
theorem says that a continuous real function assumes all intermediate values on 
an interval. 


Proof By Theorem 2.47, [a, b] is connected; hence Theorem 4.22 shows 
that f([a, b]) is a connected subset of R', and the assertion follows if we 
appeal once more to Theorem 2.47. 


4.24 Remark At first glance, it might seem that Theorem 4.23 has a converse. 
That is, one might think that if for any two points x, < x, and for any number c 
between /f(x,) and f(x,) there is a point x in (x,, x.) such that f(x) =c, then f 
must be continuous. 

That this is not so may be concluded from Example 4.27(d). 
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DISCONTINUITIES 


If x is a point in the domain of definition of the function f at which / is not 
continuous, we say that f is discontinuous at x, or that f has a discontinuity at x. 
If fis defined on an interval or on a segment, it is customary to divide discon- 
tinuities into two types. Before giving this classification, we have to define the 
right-hand and the left-hand limits of f at x, which we denote by f(x + ) and f(x -- ), 
respectively. 


4.25 Definition Let f be defined on (a, 6). Consider any point x such that 
a<x<b. We write 


S(x+) =4 


if f(t,) ~g as n— oo, for all sequences {t,} in (x, b) such that t, > x. To obtain 
the definition of f(x—), for a< x < b, we restrict ourselves to sequences {f,} in 
@, X). 


It is clear that any point x of (a, b), lim f(t) exists if and only if 
ta 
f(x+) =f(e—) = lim f(r). 


4.26 Definition Let f be defined on (a, b). If f is discontinuous at a point x, 
and if f(x+) and f(x—) exist. then fis said to have a discontinuity of the first 
kind, or a simple discontinuity, at x. Otherwise the discontinuity is said to be of 
the second kind. 

There are two ways in which a function can have a simple discontinuity: 
either f(x +) # f(x—) [in which case the value f(x) is immaterial], or f(x +) = 
POY) £ 9G). 


4.27 Examples 
(a) Define 


7 (x rational), 
Ds im to (x irrational). 


Then f has a discontinuity of the second kind at every point x, since 
neither f(x+) nor /(x—) exists. 
(b) Define 


_ {x  (* rational), 
I) = (5 (x irrational). 
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Then f is continuous at x = 0 and has a discontinuity of the second 
kind at every other point. 


(c) Define 
x+2 (-—3 <x < —2), 
fey=(sx=—2 (220): 
x+2 (Ws x= 1). 


Then f has a simple discontinuity at x =O and is continuous at 
every other point of (—3, 1). 
(d) Define 


oN 
ah sin - (x ¥ 0), 


0 (x = 0). 


Since neither f(0+) nor f(O—) exists, f has a discontinuity of the 
second kind at x =0. We have not yet shown that sin x is a continuous 
function. If we assume this result for the moment, Theorem 4.7 implies 
that fis continuous at every point x # 0. 


MONOTONIC FUNCTIONS 


We shall now study those functions which never decrease (or never increase) on 
a given segment. 


4.28 Definition Let f be real on (a,b). Then / is said to be monotonically 
increasing on (a, b) if a<x <j <b implies f(x) < f(y’). If the last inequality 
is reversed, we obtain the definition of a monotonically decreasing function. The 
class of monotonic functions consists of both the increasing and the decreasing 
functions. 


4.29 Theorem Let f be monotonically increasing on (a,b). Then f(x+) and 
J (x—) exist at every point of x of (u,b). More precisely, 


sup f(t) =/(x—) sf(x) sf(x+) = int ad {, 
a<t<x x<I< 
Furthermore, ifa<x<y <b, then 


I+) sI0-). 


Analogous results evidently hold for monotonically decreasing functions. 
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Proof By hypothesis, the set of numbers f(t), where a < t < x, is bounded 
above by the number f(x), and therefore has a least upper bound which 
we shall denote by A. Evidently A </f(x). We have to show that 
A =f(x-). 

Let ¢ > 0 be given. It follows from the definition of A as a least 
upper bound that there exists 6 > 0 such that a < x — 6 < x and 


(27) A—e<f(x-—d)<A. 
Since f is monotonic, we have 
(28) I(x -d)<f(th<A (x Oo Fe. 


Combining (27) and (28), we see that 
|f(t)-—A| <e (x —d <t<x). 


Hence f/(x—) = A. 
The second half of (25) is proved in precisely the same way. 
Next, if a < x < )' < b, we see from (25) that 


(29) fix+)y= inf fT)= minf@ 
x<t<b x<t<y 
The last equality is obtained by applying (25) to (a, y) in place of (a, b). 
Similarly, 
(30) f(y—) = sup f(t) = sup f(t). 


a<t<y x<t<y 


Comparison of (29) and (30) gives (26). 
Corollary Monotonic functions have no discontinuities of the second kind. 


This corollary implies that every monotonic function is discontinuous at 
a countable set of points at most. Instead of appealing to the general theorem 
whose proof is sketched in Exercise !7, we give here a simple proof which is 
applicable to monotonic functions. 


4.30 Theorem Ler f be monotonic on (a, b). Then the set of points of (a, b) at 
which f is discontinuous is at most countable. 


Proof Suppose. for the sake of definiteness, that f is increasing, and 
let E be the set of points at which fis discontinuous. 


With every point x of E we associate a rational number r(x) such 
that 


S(x-) < r(x) < f(x+). 
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Since x, <x, implies f(x,+) </f(x,—), we see that r(x,) #r(x,) if 
NG Xs. 

We have thus established a 1-1 correspondence between the set £ and 
a subset of the set of rational numbers. The latter. as we know, is count- 
able. 


4.31 Remark It should be noted that the discontinuities of a monotonic 
function need not be isolated. In fact. given any countable subset EF of (a, b). 
which may even be dense. we can construct a function f. monotonic on (a, b), 
discontinuous at every point of F, and at no other point of (a, 5). 

To show this, let the points of E be arranged in a sequence {x,}, 


nz WW 2, 3,.... ket fc) be a sequenee of positive numbers such that Lc, 
converges. Define 
(31) {a= hk & (a <x <B). 


The summation is to be understood as follows: Sum over those indices n 
for which x, < x. If there are no points x, to the left of 1, the sum is empty; 
following the usual convention, we define it to be zero. Since (31) converges 
absolutely, the order in which the terms are arranged is immaterial. 

We leave the verification of the following properties of / to the reader: 


(a) fis monotonically increasing on (a, 5); 
(b) fis discontinuous at every point of E; in fact. 


S&F) iF) a 
(c) fis continuous at every other point of (a. 5). 


Moreover. it is not hard to see that f(x—) = f(x) at all points of (a, 6). If 
a function satisfies this condition, we say that f is continuous from the left. Uf 
the summation in (31) were taken over all indices for which x, < x. we would 
have f(x+) = f(x) at every point of (a, 6); that is. f would be continuous from 
the right. 

Functions of this sort can also be defined by another method; for an 
example we refer to Theorem 6.16. 


INFINITE LIMITS AND LIMITS AT INFINITY 


To enable us to operate in the extended real number system, we shall now 
enlarge the scope of Definition 4.1, by reformulating it in terms of neighborhoods. 

For any real number x, we have already defined a neighborhood of + to 
be any segment (x — 6, x + 0). 
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4.32 Definition For any real c, the set of real numbers x such that x > c is 
called a neighborhood of + 00 and Is written (c. + 00). Similarly, the set (— 00, c) 
is a neighborhood of — oo. 


4.33 Definition Let / be a real function defined on E. We say that 
f(t) 7~ Aas tx, 


where A and x are in the extended real number system, if for every neighborhood 
U of A there is a neighborhood V of x such that V 4 E is not empty, and such 
that f(1) e ("for ablene | quabeityta. 

A moment’s consideration will show that this coincides with Definition 
4.1 when A and x are real. 

The analogue of Theorem 4.4 1s still true, and the proof offers nothing 
new. We state it, for the sake of completeness. 


4.34 Theorem Let f and g be defined on E. Suppose 


S(t) A, g(t)- B ast— x. 
Then 


(a) f(@)>e4” impliteg A= A. 
(b) (f+gt)> A+B. 

(e) Gwe) AB, 

(d) (fig)(t) > A/B, 


provided the right members of (b), (c), and (a) are defined. 
Note that oc — 1,0: 2, «/oo, A/O are not defined (see Definition 1.23). 


EXERCISES 
1. Suppose / is a real function defined on R! which satisfies 


lm [f(x + #4) — f(x — A) =0 


for every x € R'. Does this imply that / is continuous? 
2. If fis a continuous mapping of a metric space X into a metric space Y, prove that 


f(E)cf(E) 


for every set E< X. (E denotes the closure of E.) Show, by an example, that 
f(E) can be a proper subset of /(E). 

3. Let fbe a continuous real function on a metric space XY. Let Z(/) (the zero set of f) 
be the set of all pe X at which f(p) =0. Prove that Z(/) is closed. 

4. Let fand g be continuous mappings of a metric space Y into a metric space Y, 


10. 


11, 


12. 


13. 


CONTINUITY 99 


and let E be a dense subset of Y. Prove that f(E) is dense in f(X). If g(p) =/f(p) 
for all pe E, prove that g(p) = f(p) for all pe X. (In other words, a continuous 
mapping is determined by its values on a dense subset of its domain.) 


. If fis a real continuous function defined on a closed set E < R', prove that there 


exist continuous real functions g on R' such that g(x) = f(x) for all x € E. (Such 
functions g are called continuous extensions of f from E to R'.) Show that the 
result becomes false if the word “‘closed”’ is omitted. Extend the result to vector- 
valued functions. Hint: Let the graph of g be a straight line on each of the seg- 
ments which constitute the complement of E (compare Exercise 29, Chap. 2). 
The result remains true if R' is replaced by any metric space, but the proof is not 
so simple. 


. If fis defined on E, the graph of fis the set of points (x, f(x)), for x € E. In partic- 


ular, if E is a set of real numbers, and / is real-valued, the graph of fis-a subset of 
the plane. 

Suppose E is compact, and prove that / is continuous on E if and only if 
its graph is compact. 


. If Ec X and if fis a function defined on X, the restriction of {to E is the function 


g whose domain of definition is E, such that g(p) = f(p) for pe E. Define f and g 
on R? by: f(0, 0) = g(0, 0) =0, f(x, y) = xy?/(x? + y*), g(x, y) = xy?/(x? + y°) 
if (x, y) #(0, 0). Prove that f is bounded on R’; that g is unbounded in every 
neighborhood of (0, 0), and that f is not continuous at (0, 0); nevertheless, the 
restrictions of both f and g to every straight line in R? are continuous! 


. Let f be a real uniformly continuous function on the bounded set E in R'. Prove 


that fis bounded on E. 
Show that the conclusion is false if boundedness of E is omitted from the 
hypothesis. 


. Show that the requirement in the definition of uniform continuity can be rephrased 


as follows, in terms of diameters of sets: To every ¢ > 0 there exists a 6 > 0 such 
that diam /(E) < « for all E< X with diam E < 6. 
Complete the details of the following alternative proof of Theorem 4.19: If fis not 
uniformly continuous, then for some « > 0 there are sequences {p,}, {gn} in X such 
that dx(p,, Gn) > 0 but dy(f(p,), f(gn)) > €. Use Theorem 2.37 to obtain a contra- 
diction. 
Suppose / is a uniformly continuous mapping of a metric space X into a metric 
space Y and prove that {/(x,)} is a Cauchy sequence in Y for every Cauchy se- 
quence {x,} in X. Use this result to give an alternative proof of the theorem stated 
in Exercise 13. 
A uniformly continuous function of a uniformly continuous function is uniformly 
continuous. 

State this more precisely and prove it. 
Let E be a dense subset of a metric space X, and let / be a uniformly continuous 
real function defined on E. Prove that f has a continuous extension from E to X 
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14. 


15. 


16. 


Jue 


18. 


19. 


(see Exercise 5 for terminology). (Uniqueness follows from Exercise 4.) Hint: For 
each pe X and each positive integer n, let V,(p) be the set of all ge E with 
d(p,q) <1/n. Use Exercise 9 to show that the intersection of the closures of the 
sets {(V,(p)), f(V2(p)), ..., consists of a single point, say g(p), of R'. Prove that 
the function g so defined on _X is the desired extension of / 

Could the range space R' be replaced by R‘? By any compact metric space? 
By any complete metric space? By any metric space? 
Let / = (0, 1] be the closed unit interval. Suppose fis a continuous mapping of / 
into /. Prove that f(x) = x for at least one x € J. 
Call a mapping of X into Y open if f(V) is an open set in Y whenever V is an open 
set in X. 

Prove that every continuous open mapping of R' into R* is monotonic. 
Let [x] denote the largest integer contained in x, that is, [x] is the integer such 
that « -- 1 < [xv] <x; and let (x) = x — [x] denote the fractional part of x. What 
discontinuities do the functions [x] and (x) have? 
Let f be a real function defined on (a, b). Prove that the set of points at which f 
has a simple discontinuity is at most countable. Hint: Let E be the set on which 
S(x—) <f(x+). With each point x of E, associate a triple (p,q, r) of rational 
numbers such that 
(a). fe). =p [Cy 
(6b) axq<t<x implies f(t) <p, 
(c) x <t<r<b implies f(t) >p. 
The set of all such triples is countable. Show that each triple is associated with at 
most one point of E. Deal similarly with the other possible types of simple dis- 
continuities. 
Every rational x can be written in the form x = m/n, where n > 0, and mand n are 
integers without any common divisors. When x = 0, we take n = 1. Consider the 
function / defined on R' by 


0 (x irrational), 


f(x) = (1 ( ") 
= x=-}. 


n n 


Prove that f is continuous at every irrational point, and that / has a simple discon- 
tinuity at every rational point. 
Suppose f is a real function with domain R' which has the intermediate value 
property: If f(a) <c <f(b), then f(x) = c for some x between a and b. 

Suppose also, for every rational r, that the set of all x with f(x) = r is closed. 

Prove that fis continuous. 

Hint: Vf x, — Xo but f(x.) >r >Sf(xXo) for some r and all n, then f(/,) =r 
for some f, between xo and x,; thus ¢, > Xo. Find a contradiction. (N. J. Fine, 
Amer. Math. Monthly, vol. 73, 1966, p. 782.) 


20. 


21. 


22. 


23. 
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If E is a nonempty subset of a metric space YX, define the distance from x € X to E 
by 
pe(x) = inf d(x, z). 
zeE 


(a) Prove that pe(x) = 0 if and only if xe E. 
(6) Prove that pe is a uniformly continuous function on X, by showing that 
| pe(x) — pe(y)| < d(x, y) 

for all xe X, ye X. 

Hint: p(x) < d(x, z) < d(x, y) + d(y, z), so that 

pe(x) < d(x, y) + pely). 

Suppose K and F are disjoint sets in a metric space X, K is compact, F is closed. 
Prove that there exists 6 >0 such that d(p,q)>94 if pe K,qeF. Hint: pr isa 


continuous positive function on K. 
Show that the conclusion may fail for two disjoint closed sets if neither is 


compact. 
Let A and B be disjoint nonempty closed sets in a metric space X, and define 
pa(p) 
f(p) = ——————. e®. 
O=Tot+em & 


Show that fis a continuous function on X whose range lies in (0, 1], that f(p) =0 
precisely on A and f(p) = 1 precisely on B. This establishes a converse of Exercise 
3: Every closed set A < X is Z(/) for some continuous real fon X. Setting 


V=— "ew W=f Xap, 


show that V and W are open and disjoint, and that A < V, Bc W. (Thus pairs of 
disjoint closed sets in a metric space can be covered by pairs of disjoint open sets. 
This property of metric spaces is called normality.) 

A real-valued function f defined in (a, 5) is said to be convex if 


f(Ax + (1 — Ady) SAF(X) + (I — AYFO) 


whenever a <x <b, a<y<b,0<A<1. Prove that every convex function is 
continuous. Prove that every increasing convex function of a convex function is 
convex. (For example, if fis convex, so is e’.) 


If fis convex in (a, b) and if a<s<t<u<b, show that 


f(t) a f(u) Te jay — fa) . 


t—s u—s « u—t 


. Assume that fis a continuous real function defined in (a, 6) such that 


(222) LOL) 
2 a 


for all x, y € (a, b). Prove that fis convex. 
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25. If Ac R* and Bc R*, define A + B to be the set of all sums x + y with xe A, 

ye B. 
(a) If K is compact and C is closed in R*‘, prove that K + C is.closed. 

Hint: Take z¢ K+ C, put F =z— C, the set of all z— y with ye C. Then 
K and F are disjoint. Choose 6 as in Exercise 21. Show that the open ball with 
center z and radius 5 does not intersect K + C. 
(b) Let a be an irrational real number. Let C, be the set of all integers, let C, be 
the set of all nx with ne C,. Show that C, and C, are closed subsets of R' whose 
sum C, + C2 is not closed, by showing that C, + C, 1s a countable dense subset 
of R'. 

26. Suppose X, Y, Z are metric spaces, and Y is compact. Let f map YX into Y, let 
g be a continuous one-to-one mapping of Y into Z, and put A(x) = g(/(x)) for 
xEX. 

Prove that f is uniformly continuous if A is uniformly continuous. 

Hint: g~' has compact domain g(Y), and f(x) = g7'(A(x)). 

Prove also that / is continuous if A is continuous. 

Show (by modifying Example 4.21, or by finding a different example) that 
the compactness of Y cannot be omitted from the hypotheses, even when X and 
Z are compact. 


5 


DIFFERENTIATION 


In this chapter we shall (except in the final section) confine our attention to real 
functions defined on intervals or segments. This is not just a matter of con- 
venience, since genuine differences appear when we pass from real functions to 
vector-valued ones. Differentiation of functions defined on R* will be discussed 
in Chap. 9. 


THE DERIVATIVE OF A REAL FUNCTION 


5.1 Definition Let f be defined (and real-valued) on [a, b]. For any xe [a, b] 
form the quotient 


f(t) — f() 


(a<t<b,t#x), 
t—x 


(1) p(t) = 


and define 


(2) f(x) = lim $(), 
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provided this limit exists in accordance with Definition 4.1. 
We thus associate with the function f a function f’ whose domain 
is the set of points x at which the limit (2) exists; f’ is called the derivative 


of f. 
‘ If f’ is defined at a point x, we say that fis differentiable at x. If f’ is 
defined at every point of a set E < [a, b], we say that fis differentiable on E. 
It is possible to consider right-hand and left-hand limits in (2); this leads 
to the definition of right-hand and left-hand derivatives. In particular, at the 
endpoints a and b, the derivative, if it exists, is a right-hand or left-hand deriva- 
tive, respectively. We shall not, however, discuss one-sided derivatives in any 


detail. 
If f is defined on a segment (a, b) and if a < x <b, then f'(x) is defined 
by (1) and (2), as above. But f’(a) and f(b) are not defined in this case. 


5.2 Theorem Let f be defined on [a, b]. If f is differentiable at a point x € [a, b}, 
then f is continuous at x. 


Proof As t-—>x, we have, by Theorem 4.4, 


f= SO) 
— xX ' 


; t—x)-f'(x):0=0. 


f(t) —f(%) = 


The converse of this theorem is not true. It is easy to construct continuous 
functions which fail to be differentiable at isolated points. In Chap. 7 we shall 
even become acquainted with a function which is continuous on the whole line 
without being differentiable at any point! 


5.3. Theorem Suppose f and g are defined on [a, b] and are differentiable at a 
point x € [a,b]. Then f + g, fg, and f/g are differentiable at x, and 


(aq) (f+ 9%) =f") +9); 
(6) (f9)' (x) =f ag) + f()9'(x); 


(c) (Z ) (te Ix) f i ee g (x) f(x) 
g g (x) 


In (c), we assume of course that g(x) 4 0. 
Proof (a) is clear, by Theorem 4.4. Let A = fg. Then 


A(t) — hx) =f) lg) — 92) + 9COIP() — £0): 
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If we divide this by ¢ — x and note that f(t) + f(x) as t > x (Theorem 5.2), 
(b) follows. Next, let h = f/g. Then 


A(t)—h(x) I f(t) — fix) g(t) — g(x) 
t—x | ara Ty wie s I 


Letting ¢ > x, and applying Theorems 4.4 and 5.2, we obtain (c). 


5.4 Examples The derivative of any constant is clearly zero. If fis defined 
by f(x) = x, then f(x) = |. Repeated application of (6) and (c) then shows that 
x" is differentiable, and that its derivative is nx"~', for any integer n (if n <0, 
we have to restrict ourselves to x #0). Thus every polynomial is differentiable, 
and so is every rational function, except at the points where the denominator is 
zero. 

The following theorem is known as the “chain rule’’ for differentiation. 
It deals with differentiation of composite functions and is probably the most 
important theorem about derivatives. We shall meet more general versions of it 
in Chap. 9. 


5.5 Theorem Suppose f is continuous on |[a, b], f'(x) exists at some point 
x e€ [a,b], g is defined on an interval I which contains the range of f, and g is 
differentiable at the point f(x). If 


h(t) = 9(f(t)) (a = tex Bb), 


then h is differentiable at x, and 


(3) h'(x) = 9 (f(x) F(x). 

Proof Let y = f(x). By the definition of the derivative, we have 
(4) f(t) — f(x) = (t — x)[F'(x) + u(r], 
(5) G(s) — gy) = (5 — y)g'(¥) + v(s)]. 


where te [a, b],se/,and u(t) >Oast—>x,v(s) >Oass—ay. Lets = f(t). 
Using first (5) and then (4), we obtain 
W(t) — h(x) = 9 f(t) — 9 F(X) 

= [f(t) —f(x)] - [9') + r(5)] 

=(t— x): [f'(x) + u(t) [9'(y) + 09)], 
On @ t = x. 

(9) moe = — (g'(v) + v(s)] - (f'Ce) + a). 

Letting > x. we see that s— y, by the continuity of f, so that the right 
side of (6) tends to g‘(y) f(x), which gives (3). 
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5.6 Examples 
(a) Let f be defined by 


a! 
7) f(x) = x sin - (aD), 


0 (ay —=10). 


Taking for granted that the derivative of sin x is cos x (we shall 
discuss the trigonometric functions in Chap. 8), we can apply Theorems 
5.3 and 5.5 whenever x #0, and obtain 


(8) S@=siii E — a 2 (x #0). 
~ 6 x 


At x = 0, these theorems do not apply any longer, since !/x is not defined 
there, and we appeal directly to the definition: for t #0, 


I) TE cia 


sin — 
t—0 i 


As t 0, this does not tend to any limit, so that f’(0) does not exist. 
(b) Let f be defined by 


al 
0) _— x* sin “ (x% #0); 


0 (x = 0), 


As above, we obtain 
7 | 1 
(10) FS («)= 2x = ie (ux). 


At x = 0, we appeal to the definition, and obtain 


t)-FO I 
FE) = | sin 2 < |t| (t #0); 
letting ¢ + 0, we see that 
(11) f'(O) = 0. 


Thus / is differentiable at all points x, but f/’ is not a continuous 
function, since cos (1/x) in (10) does not tend to a limit as x +0. 
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MEAN VALUE THEOREMS 


5.7 Definition Let f be a real function defined on a metric space XY. We say 
that fhas a local maximum at a point p € X if there exists 6 > 0 such that f(q) < 
/(p) for all g € X with d(p, q) < 6. 


Local minima are defined likewise. 
Our next theorem is the basis of many applications of differentiation. 
5.8 Theorem Let f be defined on [a,b]; if f has a local maximum at a point 
x € (a, b), and if f'(x) exists, then f'(x) = 0. 
The analogous statement for local minima is of course also true. 
Proof Choose 6 in accordance with Definition 5.7, so that 
a<x-—d<x<x+6<b. 


Ifx—d <t<-x, then 
fit) ~10) , 9, 
i 
Letting t > x, we see that f’(x) > 0. 
Ifx<t<x+0, then 
Lhe! 


which shows that f’(x) < 0. Hence /’(x) = 0. 


5.9 Theorem /f f and g are continuous real functions on [a,b] which are 
differentiable in (a, b), then there is a point x € (a, b) at which 


[f() — f(a)lg'(x) = [9(6) — g(a). 
Note that differentiability is not required at the endpoints. 
Proof Put 
h(t) = [f(6) —f(a)lg(t) — [9(6) -— ga) f(t) = (ast). 
Then h is continuous on [a, b], A is differentiable in (a, b), and 
(12) h(a) = f(b)g(a) — f(a)g(b) = h(6). 


To prove the theorem, we have to show that h’(x) = 0 for some x € (a, b). 
If A is constant, this holds for every xe(a,b). If A(t) > h(a) for 
some f(a, b), let x be a point on [a, b] at which A attains its maximum 
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(Theorem 4.16). By (12), x € (a, 6), and Theorem 5.8 shows that h’(x) = 0. 
If A(t) < h(a) for some t € (a, b), the same argument applies if we choose 
for x a point on [a, 6] where / attains its minimum. 


This theorem is often called a generalized mean value theorem; the following 
special case is usually referred to as “‘the” mean value theorem: 


5.10 Theorem /f fis a real continuous function on [a, b] which is differentiable 
in (a, b), then there is a point x € (a, b) at which 


f(b) — f(a) = (6 — a) f(x). 
Proof Take g(x) = x in Theorem 5.9. 


5.11 Theorem Suppose f is differentiable in (a, b). 
(a) If f'(x) = 0 for all x € (a, b), then f is monotonically increasing. 
(b) If f'(x) =0 for all x € (a, b), then f is constant. 
(c) If f'(x) <0 for all x € (a, b), then f is monotonically decreasing. 
Proof All conclusions can be read off from the equation 
f(X2) — £(%1) = (%2 — %) F(x), 


which is valid, for each pair of numbers x,, x, in (a, 5), for some x between 
x, and x,. 


THE CONTINUITY OF DERIVATIVES 


We have already seen [Example 5.6(b)] that a function f may have a derivative 
J’ which exists at every point, but is discontinuous at some point. However, not 
every function is a derivative. In particular, derivatives which exist at every 
point of an interval have one important property in common with functions 
which are continuous on an interval: Intermediate values are assumed (compare 
Theorem 4.23). The precise statement follows. 


5.12 Theorem Suppose f is a real differentiable function on [a, b] and suppose 
f'(@) <4<f'(b). Then there is a point x € (a, b) such that f’(x) = 4. 
A similar result holds of course if f’(a) > f'(b). 
Proof Put g(t) =/f(t) — Ar. Then g’(a) < 0, so that g(t,) < g(a) for some 
t, € (a, b), and g’(b) > 0, so that g(t.) < g(b) for some f, € (a, b). Hence 


g attains its minimum on [a, b] (Theorem 4.16) at some point x such that 
a<x<b. By Theorem 5.8, g(x) =0. Hence f’(x) =. 
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Corollary Jf f is differentiable on [a,b], then f’ cannot have any simple dis- 
continuities on [a, b). 


But f’ may very well have discontinuities of the second kind. 


L’HOSPITAL’S RULE 


The following theorem is frequently useful in the evaluation of limits. 


§.13. Theorem Suppose fand gare real and differentiable in (a, b), and g'(x) #0 
for all x € (a, b), where —2 <a<b< +o. Suppose 


(3) De 
g (x) 

If 

(14) f(x) 30 and g(x) > 0 as x >, 

or if 

(15) g(x) > +o asx-a, 

then 

(16) LP, pease See 
g(x) 


The analogous statement is of course also true if x + 5, or if g(x) - —a@ 
in (15). Let us note that we now use the limit concept in the extended sense of 
Definition 4.33. 


Proof We first consider the case in which —oc < A < +0. Choose a 
real number qg such that A <q, and then choose r such that A <r <q. 
By (13) there is a point c € (a, b) such that a < x < c implies 


(17) be 
g (x) 

If a<x<y<c, then Theorem 5.9 shows that there is a point fe (x, y) 

such that 
a fo) =f) £0, 

g(x)-— gy) g(t) 
Suppose (14) holds. Letting x — a in (18), we see that 

(19) 1 eee (aye C). 


gy) 
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Next, suppose (15) holds. Keeping » fixed in (18), we can choose 

a point c, € (a, y) such that g(x) > g(y) and g(x) > Oifa<x<c,. Multi- 

plying (18) by [g(x) — 9(’)]/g(x), we obtain 
£0), ) , JM 


20 (a <x <¢,). 
— gy g(x)” g@) , 
If we let x > a in (20), (15) shows that there 1s a point c, € (a, c,) 
such that 
f (x) 
21 —< a <axX =>). 
(21) g(x) q ( 2 
Summing up, (19) and (2!) show that for any q, subject only to the 
condition A < gq, there is a point c, such that f(x)/g(x) <q ifa<x<c). 
In the same manner, if —0co < A < +0, and p= is chosen so that 
p < A, we can find a point c; such that 
(22) p< <= (Q<X <nGqi), 


and (16) follows from these two statements. 


DERIVATIVES OF HIGHER ORDER 


5.14 Definition If fhas a derivative f’ on an interval, and if f’ is itself differen- 
tiable, we denote the derivative of f’ by f” and call f” the second derivative of /. 
Continuing in this manner, we obtain functions 


a ee Rien of, 
each of which is the derivative of the preceding one. f‘” is called the nth deriva- 
tive, or the derivative of order n, of f. 

In order for f‘” (x) to exist at a point x, f~ ') (1) must exist in a neighbor- 
hood of x (or in a one-sided neighborhood, if x is an endpoint of the interval 
on which / is defined), and f‘"~ '’ must be differentiable at x. Since f“~!) must 
exist in a neighborhood of x, f‘"~ ? must be differentiable in that neighborhood. 


TAYLOR’S THEOREM 


5.15 Theorem Suppose f is a real function on [a, 6], n is a positive integer, 
f{"~ is continuous on [a, bj, f'(t) exists for every te (a, b). Let x, B be distinct 
points of [a, b], and define 


(23) P(t) = 


n-1 f™() 
>. is (t = a). 


k=0 
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Then there exists a point x between a and B such that 


f(x) 


n! 


(24) FQN =P) * 


(f — a)”. 


For n = 1, this is just the mean value theorem. In general. the theorem 
shows that f can be approximated by a polynomial of degree m — 1, and that 
(24) allows us to estimate the error, if we know bounds on | f(x)|. 


Proof Let M be the number defined by 
(25) S(B) = P(B) + M(B — x)" 
and put 
(26) g(t) =f(t) — P(t) — M(t — x)" (a<t<b). 


We have to show that n!M = f(x) for some x between ~ and f. By 
(23) and (26), 


(27) g(t) = f(t) — nM (as 4 « b). 


Hence the proof will be complete if we can show that g‘"(x) = 0 for some 
x between « and f. 
Since P™(a) = f(a) for k =0,...,2— 1, we have 


(28) Ga) = g(a) = = g" 1x) = 0. 


Our choice of M shows that 9(f) =0. so that g'(x,)=0 for some x, 
between x and ff. by the mean value theorem. Since g(x) = 0. we conclude 
similarly that g"(x,) = 0 for some x, between x and x,. After m steps we 
arrive at the conclusion that g"”(x,) = 0 for some x, between x and x, _,, 
that is, between x and f. 


DIFFERENTIATION OF VECTOR-VALUED FUNCTIONS 


5.16 Remarks Definition 5.1 applies without any change to complex functions 
f defined on {a, bj, and Theorems 5.2 and 5.3, as well as their proofs. remain 
valid. If f, and f, are the real and imaginary parts of /. that ts, if 


f(t) =f(t) + fat) 
for a <t <b, where f,(t) and f,(t) are real, then we clearly have 
(29) Sx) = fi) + 209); 


also, f is differentiable at x if and only if both f, and /, are differentiable at x. 
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Passing to vector-valued functions in general, i.e., to functions f which 
map [a, b] into some R*, we may still apply Definition 5.1 to define f’(x). The 
term $(t) in (1) is now, for each f, a point in R*, and the limit in (2) is taken with 
respect to the norm of R*. In other words, f’(x) is that point of RX (if there is 
one) for which 


f(t) —f 
(30) lim ae f’(x)| = 0, 
tox t = OS 
and f’ is again a function with values in R*. 
If fi, ..-, f, are the components of f, as defined in Theorem 4.10, then 
(31) i =GF.... fo 
and f is differentiable at a point x if and only if each of the functions f,, ...,f, 


is differentiable at x. 

Theorem 5.2 is true in this context as well, and so is Theorem 5.3(a) and 
(b), if fg is replaced by the inner product f+ g (see Definition 4.3). 

When we turn to the mean value theorem, however, and to one of its 
consequences, namely, L’Hospital’s rule, the situation changes. The next two 
examples will show that each of these results fails to be true for complex-valued 
functions. 


5.17 Example Define, for real x, 
(32) f(x) =e™* =cos x + isin x. 


(The last expression may be taken as the definition of the complex exponential 
e'*; see Chap. 8 for a full discussion of these functions.) Then 


(33) f(2n) —f) =1-—1=0, 
but 
(34) f'(x) = ie™, 


so that |f’(x)| = 1 for all real x. 
Thus Theorem 5.10 fails to hold in this case. 


5.18 Example On the segment (0, 1), define f(x) = x and 


(35) g(x) = x + xet/*’, 
Since |e‘'| = 1 for all real t, we see that 
(36) tity EO, 


+0 9(X) 


Next, 
(37) 

so that 
(38) 
Hence 
(39) 
and so 


(40) 


gilea= | + [2x — =| ee (Om =, 


lg'(x)| = 2 = 2 l ~—— Ive 
X x 
I(x) - I ” x 
g(x)| \qie| ~2—<x 
ee 0 
x09 (x) 
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By (36) and (40), L’Hospital’s rule fails in this case. Note also that g(x) #0 


on (0, 1), by (38). 


However. there is a consequence of the mean value theorem which, for 
purposes of applications. is almost as useful as Theorem 5.10. and which re- 
mains true for vector-valued functions: From Theorem 5.10 it follows that 


(41) 


lS ta ct: at ag) 


5.19 Theorem Suppose f is a continuous mapping of [a.h] into R* and f£ is 
differentiable in (a, b). Then there exists x € (a,b) such that 


Proof! 


|f(b) -- f(a)| < (b — a) 


fi)|:. 


Put z = f(b) — f(a), and define 


oimy=2-fr) (@etse®). 


Then ¢ is a real-valued continuous function on [a, 5} which is differentia- 
ble in (a. 6). The mean value theorem shows therefore that 


g(b) — g(a) = (6 — aye’ (x) = (6 - ajz: F(x) 


for some x € (a,b). On the other hand, 


gb) — pla) = 2° f(b) —2° f(a) =z°2z = | 


The Schwarz inequality now gives 


|z|?=(b—a)|z:f(x)| <(b — a){z| |f( 


zl. 


x)|. 


Hence |z| < (+ — a)|f(x)|, which is the desired conclusion. 


1V. P. Havin translated the second edition of this book into Russian and added this 
proof to the original one. 
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EXERCISES 
1. Let f be defined for all real x, and suppose that 
\ey—Feoik= (x — 
for all real x and y. Prove that fis constant. 
2. Suppose f‘(x) > 0 in (a, 6). Prove that fis strictly increasing in (a, 5), and let g be 
its inverse function. Prove that g is differentiable, and that 


I (fo) = 


(Ge<oxce< bi), 

Ae ) ; 

3. Suppose g is a real function on R', with bounded derivative (say |g’| <M). Fix 
€ > 0, and define f(x) = x + eg(x). Prove that fis one-to-one if € is small enough. 
(A set of admissible values of ¢€ can be determined which depends only on M.) 

4. If 


qa 2... = 2 
2 n n+1 
where Co, ..., C, are real constants, prove that the equation 
Gow Gi® 4° °° Geet’ + Gare G 


has at least one real root between 0 and 1. 
5. Suppose fis defined and differentiable for every x > 0, and f(x) ->Oas x -+ + x. 
Put g(x) = f(x + 1) — f(x). Prove that g(x) > Oas x > +2. 
6. Suppose 
(a) fis continuous for x > 0, 
(b) f’(x) exists for x > 0, 


(c) f(0) =9, 
(d) f’ is monotonically increasing. 
Put 
x= &>0) 


and prove that g is monotonically increasing. 
7. Suppose f’(x), g‘(x) exist, g (x) #0, and f(x) = g(x) = 0. Prove that 
I(t) _ fx) 
im —— 
rx g(t) g(x) 


(This holds also for complex functions.) 
8. Suppose /’ is continuous on [a, b] and e > 0. Prove that there exists 6 > 0 such 
that 


AoW i) on on 


10. 


iI. 


12. 


13. 


14. 


5. 
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whenever 0 < [f- x| <6, ax x<b, a<t<b. (This could be expressed by 
saying that fis uniformly differentiable on [a, b] if f’ is continuous on [a, b].) Does 
this hold for vector-valued functions too? 


. Let f be a continuous real function on R', of which it is known that f(x) exists 


for all x 4 O and that f(x) > 3 as x +0. Does it follow that {(0) exists? 
Suppose fand g are complex differentiable functions on (0, 1), f(x) — 0, g(x) -> 0, 
I(x) > A, g(x) > Bas x — 0, where A and Bare complex numbers, B ’ 0. Prove 
that 


x70 g(x) B 
Compare with Example 5.18. Hint: 
F@) FS) | @ x 
ee ae 
g(x) x | eo g(x) 


Apply Theorem 5.13 to the real and imaginary parts of f(x)/x and g(x)/x. 


Suppose / is defined in a neighborhood of x, and suppose f(x) exists. Show that 
lim f(x +h) = — h) — 2f(x) = f(x), 
h-O 


Show by an example that the limit may exist even if f’(x) does not. 
Hint: Use Theorem 5.13. 
If f(x) == |x|?, compute f(x), f(x) for all real x, and show that f‘*(0) does not 
exist. 
Suppose a and c are real numbers, c > 0, and fis defined on [—1, 1] by 


tes. ( °°) (Hie == O); 
LO ag Gifacer=a0)) 


Prove the following statements: 

(a) fis continuous if and only if a > 0. 

(b) f’(O) exists if and only if a > 1. 

(c) f’ is bounded if and only if a>1 - c. 

(d) f’ is continuous if and only ifa>1-+4-c. 

(e) f’(0) exists if and only ifa>2+4-c. 

(Sf) f” is bounded if and only if a >2 + 2c. 

(g) f” is continuous if and only if a > 2 +4 2e. 

Let f be a differentiable real function defined in (a, 6). Prove that fis convex if 
and only if f’ is monotonically increasing. Assume next that f”(x) exists for 
every x € (a, b), and prove that fis convex if and only if f’(x) > 0 for all x € (a, b). 
Suppose a € R', fis a twice-differentiable real function on (a, ©), and Mo, M,, M2 
are the least upper bounds of |/(x)|, |/’(x)|, |/’(@)|, respectively, on (a, «). 
Prove that 


Mi <4M. M2. 
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Hint: If h > 0, Taylor’s theorem shows that 
1 
f(x) = 5 UL + 2h) =f) —hif) 


for some € € (x, x + 2h). Hence 


M 
If’) | <AM2 + a 


To show that M? = 4M. M, can actually happen, take a = —1, define 
2x? — I] (—1<x <0), 


f(x) = (x? —1 
x7-+1 


(OK 2x°<—09); 


and show that Mp = 1, M, = 4, M2 = 4. 
Does M? <4M¢ M, hold for vector-valued functions too? 
16. Suppose / is twice-differentiable on (0, «), f” is bounded on (0, 0), and f(x) > 0 
as x > 0. Prove that f(x) ~Oas x > 0. 
Hint: Let a — © in Exercise 15. 
17. Suppose / is a real, three times differentiable function v.1 [— 1, 1], such that 
Prove that f‘(x) > 3 for some x € (—1, 1). 
Note that equality holds for 4(x* + x?). 
Hint: Use Theorem 5.15, with a =0 and B = +1, to show that there exist 
s €(0, 1) and ¢ € (—1, 0) such that 
FO) ef OSE 
18. Suppose / is a real furtction on [a, 5], 1 is a positive integer, and f~' exists for 
every ¢ € [a, b]. Let a, 8, and P be as in Taylor’s theorem (5.15). Define 


Hit) — Fi) 
t— 


Q(t) = 8 


for ¢ € (a, b), t + B, differentiate 
F(t) — f(B) = (t — BQ) 
n— | times at ¢t = a, and derive the following version of Taylor’s theorem: 
f(B) = Pip) + 2 8 — ay 
19. Suppose / is defined in (—1, 1) and f’(0) exists. Suppose —1 <a, <f, <1, 
a, > 0, and 8, >0 as” -> 0. Define the difference quotients 


= f(Bn) =f) } 


= Bs — Xn 


20. 


21. 


22. 
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Prove the following statements: 

(a) If «, <0 <8,, then lim D, = f’(0). 

(b) If 0 <a, < B, and {8,/(8, — «»)} is bounded, then lim D, = f’(0). 
(c) If f’ is continuous in (—1, 1), then lim D, = /’(0). 

Give an example in which / is differentiable in (—1, 1) (but /’ is not contin- 
uous at 0) and in which «,, 8, tend to 0 in such a way that lim D, exists but is differ- 
ent from /’(0). 

Formulate and prove an inequality which follows from Taylor’s theorem and 
which remains valid for vector-valued functions. 

Let E be a closed subset of R'. We saw in Exercise 22, Chap. 4, that there is a 
real continuous function fon R' whose zero set is E. Is it possible, for each closed 
set E, to find such an f which is differentiable on R', or one which is # times 
differentiable, or even one which has derivatives of all orders on R'? 
Suppose f is a real function on (— x, x). Call x a fixed point of fif f(x) = x. 
(a) If fis differentiable and f(t) 4 1 for every real ¢, prove that f has at most one 
fixed point. 

(b) Show that the function f defined by 


f)=t+ +e"! 


has no fixed point, although 0 < f’(t) < 1 for all real f. 

(c) However, if there is a constant A < | such that |f’(t)| <A for all real f, prove 
that a fixed point x of f exists, and that . = lim x,, where x, is an arbitrary real 
number and 


Xn+1 = eine) 


Ce a 
(d) Show that the process described in (c) can be visualized by the zig-zag path 


(6.05) a ee Oe, 5) ia I (in, Xa °° 


. The function f defined by 


x3 +] 


f(x) = 3 


has three fixed points, say «, B, y, where 
—2<a<-l, O<f<1, l= yee 2 


For arbitrarily chosen x,, define {x,} by setting xn41 =S (xn). 
(a) If x, <«, prove that x, > — 2 asn > ©. 

(b) If «<x, <y, prove that x, > B asm—o. 

(c) If y < x,, prove that x, > +0 asn > ©. 

Thus f can be located by this method, but « and y cannot. 
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24. 


25: 


The process described in part (c) of Exercise 22 can of course also be applied to 
functions that map (0, ©) to (0, «). 
Fix some « > 1, and put 


c= 3(x+ 8), g(x) = 5. 


Both f and g have V « as their only fixed point in (0, 0). Try to explain, on the 
basis of properties of f and g, why the convergence in Exercise 16, Chap. 3, is so 
much more rapid than it is in Exercise 17. (Compare f’ and g’, draw the zig-zags 
suggested in Exercise 22.) 

Do the same when 0 < « < 1. 
Suppose f is twice differentiable on [a, b], f(a) < 0, f(b) > 0, f(x) >5 > 0, and 
0</f"’(x) <M for all x € [a,b]. Let € be the unique point in (a, b) at which 
f(£) =0. 

Complete the details in the following outline of Newton’s method for com- 
puting &. 
(a) Choose x, € (€, b), and define {x,} by 


—_ £On) 
S (Xn) 
Interpret this geometrically, in terms of a tangent to the graph of f. 
(6) Prove that x,+1 <x, and that 


Xn+1=Xn 


lin x,€. 


n~»> 0 


(c) Use Taylor’s theorem to show that 


F"(tn) 
2h" (Xn) 


(& i §)? 


en — oe = 


for some ft, € (&, Xn). 
(d) If A = M/26, deduce that 


1 
O<xni4i—€ 5 eos)”. 
(Compare with Exercises 16 and 18, Chap. 3.) 


(e) Show that Newton’s method amounts to finding a fixed point of the function 
g defined by 


How does g‘(x) behave for x near €? 
(f) Put f(x) = x'/? on (— 0, 0) and try Newton’s method. What happens? 


26. 


a. 


28. 


29. 
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Suppose / is differentiable on [a, b], f(a) = 0, and there is a real number A such 
that jf’(«)| < Alf(x)| on [a, 6). Prove that f(x) = 0 for all x € [a, 6). Hint: Fix 
Xo € [a, 5], let 

Mo = sup| f(x)|, 1 = sup|f(x)| 
for @ < * zw. For @wysuch x, 

If(x)| < M,(xo — a) < A(Xo — a)Mo. 
Hence Mo =: 0 if A(xo — a) < 1. That is, f=0 on [a, xo]. Proceed. 
Let 4 be a real function defined on a rectangle R in the plane, given by a<x <b, 
a<y<f. A solution of the initial-value problem 

Y =, HAZ eraeap) 
is, by definition, a differentiable function fon [a, 6] such that f(a) = c, « <f(x) <8, 
and 
f(x) = P(x, fQX)) (ax x<b). 

Prove that such a problem has at most one solution if there is a constant A such 


that 
I P(x, v2) — O(x, 1)| < Aly — y1| 
whenever (.v, yi) € R and (x, y2) € R. 
Hint: Apply Exercise 26 to the difference of two solutions. Note that this 
uniqueness theorem does not hold for the initial-value problem 


y=y'’, y(0)=0, 
which has two solutions: /(x«) = 0 and f(x) = x?/4. Find all other solutions. 


Formulate and prove an analogous uniqueness theorem for systems of differential 
equations of the form 


Yi =P(X, V1, --- Ves = =YMab=cy (f= 1,...,k). 
Note that this can be rewritten in the form 
y = (x,y), ylaj)=c 


where y =()1,..., x) ranges over a k-cell, @ is the mapping of a (k + 1)-cell 
into the Euclidean k-space whose components are the functions ¢1,..., dx, and ¢ 
is the vector (c,,..., cx). Use Exercise 26, for vector-valued functions. 

Specialize Exercise 28 by considering the system 


Vi =Vyer (aie. a 2); 
k 
Ye =fLON — X gikodys, 
where f, gi, ..., gx are continuous real functions on [a, 6], and derive a uniqueness 
theorem for solutions of the equation 
yO + gixy—? + + gaOdy’ + aildy = £0, 
subject to initial conditions 


y(a) BEA Gi, y(a)=¢2, lia | pe ay ec,,.. 


6 


THE RIEMANN-STIELTJES INTEGRAL 


The present chapter is based on a definition of the Riemann integral which 
depends very exphcitly on the order structure of the real line. Accordingly, 
we begin by discussing integration of real-valued functions on intervals. Ex- 
tensions to complex- and vector-valued functions on intervals follow in later 
sections. Integration over sets other than intervals is discussed in Chaps. 10 
and 11. 


DEFINITION AND EXISTENCE OF THE INTEGRAL 
6.1 Definition Let [a,b] be a given interval. By a partition P of [a, b] we 
mean a finite set of points xo, x,,..., X,, where 
w= N% SxS See: 
We write 


Ax, =X;— X;-1 C=T, ..... 
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Now suppose / is a bounded real function defined on [a, b]. Corresponding to 
each partition P of [a, b] we put 


M, = sup f(x) Cj. 1 BX BR), 
m, = inf f(x) Ge, 2% & &); 


UPS) = Mi Ax, 


L(P.f) = Sm Axi, 


and finally 

(1) \- fide % imPOPef), 
b 

2) [ fax = sup L(P.S), 


where the inf and the sup are taken over all partitions P of [a,b]. The left 
members of (1) and (2) are called the upper and lower Riemann integrals of f 
over [a, 5}, respectively. 

If the upper and lower integrals are equal, we say that f is Riemann- 
integrable on {a, b], we write fe @ (that is, # denotes the set of Riemann- 
integrable functions), and we denote the common value of (1) and (2) by 


3) [ fas, 
or by 

b 
(4) [ 4) ax. 


This is the Riemann integral of f over [a,b]. Since f is bounded, there 
exist two numbers, m and M, such that 


m<f(x)<M (a<x<hb). 
Hence, for every P, 
m(b — a) < L(P, f) < U(P,f) < M(b — a), 
so that the numbers L(P, f) and U(P, f) form a bounded set. This shows that 
the upper and lower integrals are defined for every bounded function f, The 
question of their equality, and hence the question of the integrability of /, is a 


more delicate one. Instead of investigating it separately for the Riemann integral, 
we shall immediately consider a more general situation. 
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6.2 Definition Let « be a monotonically increasing function on [a, b] (since 
a(a) and «(b) are finite, it follows that « is bounded on [a, b]). Corresponding to 
each partition P of [a, b], we write 


Aa; = a(x;) — a(x;-1). 


It is clear that Aa; >0. For any real function f which is bounded on [a, 5] 
we put 


Or a= ye M, Aa,;, 
i=1 


bOP sf, a) = > m,; A, , 
i=1 
where M,, m; have the same meaning as in Definition 6.1, and we define 


(5) [ fe—inhueyae. 


(6) [See =supL@, /, 2). 


the inf and sup again being taken over all partitions. 


If the left members of (5) and (6) are equal, we denote their common 
value by 


(7) [ fae 


or sometimes by 


b 
(8) [. £2) dao. 


This is the Riemann-Stieltjes integral (or simply the Stieltjes integral) of 
f with respect to a, over [a, 5]. 

If (7) exists, 1.e., if (5) and (6) are equal, we say that f is integrable with 
respect to a, in the Riemann sense, and write fe A(a). 

By taking a(x) = x, the Riemann integral is seen to be a special case of 
the Riemann-Stieltjes integral. Let us mention explicitly, however, that in the 
general case « need not even be continuous. 

A few words should be said about the notation. We prefer (7) to (8), since 
the letter x which appears in (8) adds nothing to the content of (7). It is im- 
material which letter we use to represent the so-called “‘variable of integration.” 
For instance, (8) is the same as 


[ J (y) da(y). 
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The integral depends on f, x, a and 5, but not on the variable of integration, 
which may as well be omitted. 

The role played by the variable of integration is quite analogous to that 
of the index of summation: The two symbols 


are the same, since each means c, +c, + °°* + ¢,. 

Of course, no harm is done by inserting the variable of integration, and 
in many cases it is actually convenient to do so. 

We shall now investigate the existence of the integral (7). Without saying 
so every time, f will be assumed real and bounded, and « monotonically increas- 


ing on [a, b]; and, when there can be no misunderstanding, we shall write | in 


place of [ - 


6.3 Definition We say that the partition P* is a refinement of P if P* >P 
(that is, if every point of P is a point of P*). Given two partitions, P, and P,, 
we say that P* is their common refinement if P* =P, UP. 


6.4 Theorem Jf P* is a refinement of P, then 


(9) L{P,f, @) = L(P*,f, 0) 
and 
(10) OG”, faa) & UP, fae. 


Proof To prove (9), suppose first that P* contains just one point more 
than P. Let this extra point be x*, and suppose x;_,< x* < x;, where 
x;., and x; are two consecutive points of P. Put 


wy anf fe) G4 2% = #*), 
w, = inf f(x) eo <.% = x;). 
Clearly w, > m, and w, > m;, where, as before, 
m, = inf f(x) (Xj-1 SX S xj). 
Hence 
L(P*, f, a) — L(P, f, a) 
= w,[a(x*) — o(x;-1)] + wola(x,) — a(x*)] — mila(xi) — #0 -1))] 
= (w, — m;)[a(x*) — a(x;_-1)] + (w2 — mi)la(x,) — a(x*)] > 0. 


If P* contains k points more than P, we repeat this reasoning k 
times, and arrive at (9). The proof of (10) is analogous. 
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6.5 Theorem \ ldwe [ St da. 


Proof Let P* be the common refinement of two partitions P, and P,. 
By Theorem 6.4, 


L(P;,f, #) < L(P*, f. a) < U(P*, f, a) < U(P2,f, a). 

Hence 
(11) L(P,;,f, a) S U(P2,f, a). 

If P, is fixed and the sup is taken over all P;, (11) gives 
(12) [fda < U(P2,f, a). 
The theorem follows by taking the inf over all P, in (12). 
6.6 Theorem /e€ #(a) on [a, b] if and only if for every €>0 there exists a 
partition P such that 
(13) OC, f, a) — Lyf, @) < «. 


Proof For every P we have 


L(P,f, 2) < fae < [fa < U(P,f, a). 


Thus (13) implies 
O< | fdx- [fda <e. 


Hence, if (13) can be satisfied for every ¢ > 0, we have 


| fda = [ fae, 


that is, fe B(a). 
Conversely, suppose fe &(a), and let e >0 be given. Then there 
exist partitions P, and P, such that 


(14) U(P,f,0) — f fda < > 


(15) [ fda - LPS, a <=. 
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We choose P to be the common refinement of P, and P,. Then Theorem 
6.4, together with (14) and (15), shows that 


U(P, f, 8) < U(P2,f.a) < [fda +> <L(P, fa) +S L(P,f,%) +6, 
so that (13) holds for this partition P. 


Theorem 6.6 furnishes a convenient criterion for integrability. Before we 
apply it, we state some closely related facts. 


6.7 Theorem 
(a) If (13) holds for some P and some e, then (13) holds (with the same e) 
for every refinement of P. 
(b) If (13) holds for P ={xo,..., X,} and if s;, t; are arbitrary points in 
[u.,, Xe), then 


y If(s;)) —f(t;)| Aa; <e. 
(c) If fe R(x) and the hypotheses of (b) hold, then 


> I(t bey,— [s da 


< €, 


Proof Theorem 6.4 implies (a). Under the assumptions made in (b), 
both f(s;) and f(¢;) lie in [m,;, M;,], so that | f(s,;) —f(t;)| <M; —m;. Thus 


¥ Mee) Sed] Aas < UPL, #) — LP, f 2, 


which proves (6). The obvious inequalities 


L(P, f, a) = S(t) Aa; = U(P, f,«) 


L(P, f, 0) < J fda < U(P,f, «) 


and 
prove (c). 


6.8 Theorem I/f f is continuous on (a, b] then fe (a) on [a, b). 
Proof Let ¢ >0 be given. Choose yn > 0 so that 
[a(b) — a(a)}n <e. 


Since f is uniformly continuous on {a, 6] (Theorem 4.19), there exists a 
6 > 0 such that 


(16) If) -fO| <0 
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if x € [a, b], te [a, b), and |x —t| <6. 
If P is any partition of {a, b) such that Ax; <6 for all i, then (16) 
implies that 
(17) M,-m,;<n CG =i... W 
and therefore 


U(P, fia) —L(P, fia) = 3 (M, — m;) Ax; 
i= 


<n¥. Aa, = nab) — a(a)] <e. 
i=1 
By Theorem 6.6, fe A(x). 


6.9 Theorem If f is monotonic on [a, b), and if x is continuous on [a, b}, then 
fe Ra). (We still assume, of course, that « is monotonic.) 


Proof Let « >0 be given. For any positive integer 1, choose a partition 
such that 
_ a(b) — a(a) 


* aa (7 1... . «ie 
n 


Ax 


This is possible since a is continuous (Theorem 4.23). 
We suppose that fis monotonically increasing (the proof is analogous 
in the other case). Then 


M,; =f (x)), m; = f(x;-1) (i= 1+ ogg), 


so that 
b = n 
UPI.) ~ L(P,f,0) = "BO ¥' fix) — fr.) 
b) — a(h 
= 46) — flay) <¢ 


if n is taken large enough. By Theorem 6.6, fe A(a). 


6.10 Theorem Suppose f is bounded on [a,b], f has only finitely many points 
of discontinuity on [a, b], and « is continuous at every point at which f is discon- 
tinuous. Then f € R(a). 


Proof Let ¢>0 be given. Put M = sup |/f(x)|, let E be the set of points 
at which f is discontinuous. Since E is finite and « is continuous at every 
point of E, we can cover E by finitely many disjoint intervals [u,, v;] < 
[a, b} such that the sum of the corresponding differences a(v;) — x(w,) is 
less than ¢. Furthermore, we can place these intervals in such a way that 
every point of E - (a, 5) lies in the interior of some [u;, v,]. . 
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Remove the segments (u;,v,;) from [a,b]. The remaining set K is 
compact. Hence f is uniformly continuous on K, and there exists 6 > 0 
such that | f(s) —/f(r)| <eifse K, te K, |s—t| <6. 

Now form a partition P = {x9, X,,..., X,$ Of [a, b], as follows: 
Each u; occurs in P. Each r; occurs in P, No point of any segment (u,, v,) 
occurs in P. If x;_, is not one of the u;, then Ax; < 6. 

Note that Af; - m; < 2M for every i, and that M,; — m; < € unless 
X;-, 1s one of the u;. Hence, as in the proof of Theorem 6.8, 


U(P, f, x) — L(P, f, a) < [a(b) — x(a)Je + 2Me. 


Since ¢ is arbitrary, Theorem 6.6 shows that fe A(z). 
Note: If fand x have a common point of discontinuity, then f need not 


be in A(x). Exercise 3 shows this. 


6.11 Theorem Suppose fe B(x) on [a,b], m< f< M, @ is continuous on 
[m, M], and h(x) = @(f(a)) on [a, 6]. Then he #(2) on [a, 6}. 


(18) 


(19) 


Proof Choose ¢ >0. Since ¢ is uniformly continuous on (m, M], there 
exists 6 >0 such that 6<e and |¢(s) — $(t)| <e if |s—t| <6 and 
s,te[m, M). 

Since fé A(x), there is a partition P = {x9, .X,,....- x,} Of [a, b] such 
that 


U(P, f, x) — L(P, f, %) < 8”. 


Let M;, m; have the same meaning as in Definition 6.1, and let M*, m7 
be the analogous numbers for /. Divide the numbers 1, ..., 7 into two 
classes: i€¢ A if M; —m,; <6, '€ Bif M; —m;, > 6. 

For ie€ A, our choice of 6 shows that M* — mF < e. 

For ie B, M* — ms < 2K, where K = sup|@(t)|, m<t< M. By 
(18), we have 


6) Aa, < >} (M; — m)) Ag; < 6? 
ieB 


ie B 
so that ) ;-3 Aa; <6. It follows that 
U(P, h, x)— L(P, h, 2) = > (M# — mi) Aa; + > (M¥ — mF) Aa; 
ie A ie B 
< e[a(b) — x(a)] + 2K < ef[a(b) — a(a) + 2K). 


Since ¢ was arbitrary, Theorem 6.6 implies that h € A(«). 
Remark: This theorem suggests the question: Just what functions are 


Riemann-integrable? The answer is given by Theorem 11 .33(D). 
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PROPERTIES OF THE INTEGRAL 


6.12 Theorem 
(a) If f, € Ba) and f, € R(a) on [a, 5}, then 


fi + hr € Ra), 


cf € R(x) for every constant c, and 


[Uthda= [fidet [fra 


b 
[of de =o S da. 
(6) Iff,\(x) <f,(4) on [a, b), then 
b b 
[ fdas | fide. 


(c) If fe Ra) on [a, b] and if a<c<pb, then fe Ra) on [a,c] and on 
[c, b], and 


[ fda + ie fips i" pee. 
(@) Iff ¢ EG) on [a, B) and if |f(@)| < Mon fa, bh thon 
Lf fa 
(€) If fe Mo) and fe R(a3), then fe Mo, +0) and 


< M[a(b) — a(a))}. 


b b b 
[ face, +a,)= | fda, + [ fdas; 
if f € Ba) and c is a positive constant, then f € R(ca) and 
b b 
| fd(cx) =c i f da. 


Proof If f=/, +f, and P is any partition of [a, b], we have 
(20) LP, f,90) + LP f,.0) = LPS, @ 
< U(P, f,«) < U(P, f,, a) + UP, fr, &). 


If f, € A(a) and f, € Aa), let e > 0 be given. There are partitions P, 
(j = 1, 2) such that 


U(P,,f;, 0) — LP ysfjsa) <e. 


(21) 


6.13 
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These inequalities persist if P, and P, are replaced by their common 
refinement P. Then (20) implies 


U(P, f, «) — L(P, f, «) < 2e, 
which proves that fe #(a). 
With this same P we have 
OEP, foram | fdetmow” (j= 12); 
hence (20) implies 
[fidx < U(P,f, a) <JSf, dat Jf, da + 2¢. 
Since € was arbitrary, we conclude that 


{fda< ff, dat ff, dx. 


If we replace f, and f, in (21) by —f, and —/,, the inequality is 
reversed, and the equality is proved. 

The proofs of the other assertions of Theorem 6.12 are so similar 
that we omit the details. In part (c) the point is that (by passing to refine- 
ments) we may restrict ourselves to partitions which contain the point c, 
in approximating f fd. 


Theorem [ff € 2(x) and g € B(x) on [a, b], then 
(a) fg € Ax); 


(b) |f| € @(a) and [fa <[ \f| dex. 


Proof If we take ¢(t) = 17, Theorem 6.11 shows that f? € A(x) if fe A(x). 
The identity 


4fg =(f+g9) —(f-9) 
completes the proof of (a). 
If we take $(t) = |t|, Theorem 6.11 shows similarly that | f|/.€ #(«). 
Choose c = +1, so that 
cf[fda>o. 
Then 
| Jfda| =cf[fda=fcfdas< f |f| da, 


since cf < |f]|. 


6.14 Definition The unit step function I is defined by 


0 (x = 0); 


=), ws). 
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6.15 Theorem Ifa<s <b, f is bounded on {a, b], f is continuous at s, and 
a(x) = I(x —s), then 


b 
[ fda =f(s). 
Proof Consider partitions P ={x»,, %).X%.5%), Where xo =a) ad 
x, = <x) ee =e ee 
UCP, f= Mx, L(B, fd) ae. 
Since f is continuous at s, we see that M, and m1, converge to f(s) as 


XS. 


6.16 Theorem Suppose c, > 0 for 1, 2, 3,..., Lc, converges, {s,} is a sequence 
of distinct points in (a, b), and 


(22) a(x) = J. ¢1(x —5,). 


Let f be continuous on [a, b]. Then 


oO 


b 
(23) J fda = ¥ cy S(sy) 


Proof The comparison test shows that the series (22) converges for 
every x. Its sum a(x) is evidently monotonic, and a(a) = 0, a(b) = Xe,. 
(This is the type of function that occurred in Remark 4.31.) 

Let ¢ > 0 be given, and choose N so that 


és 
Ga <a 
N+1 


Put 
N oo 
a(x) aa > Cn I(x x Sn)» a(x) = ps Cn I(x “a Sn)- 
n=1 N+1 
By Theorems 6.12 and 6.15, 
b N 
(24) J, Fas = eof a). 
Since «,(b) — a,(a) < , 


b 
(25) i fda,|< Me, 


THE RIEMANNG-STIELTJES INTEGRAL 131 


where M = sup|f(x)|: Since a =a, + a2, it follows from (24) and (25) 
that 


(26) | i "te uy c,f(5,)| < Me. 


If we let N — 00, we obtain (23). 


6.17 Theorem Assume « increases monotonically and «' € & on {a,b}. Let f 
be a bounded real function on [a, 6). 
Then f € R(a) if and only if fa’ e @. In that case 


(27) { fda = rf" f (x)a'(x) dx. 


Proof Let ¢ >0 be given and apply Theorem 6.6 to «’: There is a par- 
tition P= {2,,,....5.X~} OL, [4,,)) such that 


(28) U(P, a’) — L(P, a’) <é. 
The mean value theorem furnishes points ¢; € [x;_,, x;] such that 
Aa; = a’(t;) Ax; 
foreisaely ... teed fespe[x,— 45-24] thon 
(29) > |a’(s)) — a'(t)| Ax; <e, 
i=1 


by (28) and Theorem 6.7(b). Put M = sup|f(x)|. Since 
YA) da, = Y S6)e() dx 
it follows from (29) that 
(30) Y, fle) day = Y. f(sda'(s,) Ax,| < Me 
In particular, 
3 S(s;) Aa; < UCP, fo’) + Me, 


for all choices of s; € [x;_,, x;], so that 
U(P, f, a) < U(P, fa’) + Me. 
The same argument leads from (30) to 


U(P, fa’) < U(P,f, «) + Me. 
Thus 
(31) | U(P, f, «) — U(P, fa’)| < Me. 
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Now note that (28) remains true if P is replaced by any refinement. 
Hence (31) also remains true. We conclude that 


7b >b 
| fda — | Ff ()a’(x) dx | < Me. 
But ¢ is arbitrary. Hence 
pb pb 
(32) [fda =| fx)a'(x) dx, 


for any bounded f, The equality of the lower integrals follows from (30) 
in exactly the same way. The theorem foilows. 


6.18 Remark The two preceding theorems illustrate the generality and 
flexibility which are inherent in the Stieltjes process of integration. If « is a pure 
step function [this is the name often given to functions of the form (22)], the 
integral reduces to a finite or infinite series. If « has an integrable derivative, 
the integral reduces to an ordinary Riemann integral. This makes it possible 
in many cases to study series and integrals simultaneously, rather than separately. 

To illustrate this point, consider a physical example. The moment of 
inertia of a straight wire of unit length, about an axis through an endpoint, at 
right angles to the wire, is 


(33) [2 dm 


where m(x) is the mass contained in the interval [0, x]. If the wire is regarded 
as having a continuous density p, that is, if m’(x) = p(x), then (33) turns into 


1 
(34) i: x? p(x) dx. 


On the other hand, if the wire is composed of masses m; concentrated at 
points x;, (33) becomes 


(35) Y x? m. 


Thus (33) contains (34) and (35) as special cases, but it contains much 
more; for instance, the case in which m is continuous but not everywhere 
differentiable. 


6.19 Theoren (change of variable) Suppose ¢ is a strictly increasing continuous 
function that maps an interval [A, B] onto [a,b]. Suppose « is monotonically 
increasing on [a, b] and fe &(a) on [a, b]. Define B and g on [A, B] by 


(36) By) = «(9()), = 9) = F(90)). 
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Then g € &(B) and 
(37) [. ould f Sell 


Proof To each partition P = {xy, ..., x,} of [a, b] corresponds a partition 
Q ={y0,---> Yn} Of [A, B], so that x; = g(y,). All partitions of [A, B] 
are obtained in this way. Since the values taken by f on [x;_,, x;] are 
exactly the same as those taken by g on [y,_,, y,;], we see that 


(38) U(Q, 9, B)= U(P,f,«), LIQ, 9, B)=LP.S, «). 


Since f€ @(a), P can be chosen so that both U(P, f, «) and L(P, f, a) 
are close to { fda. Hence (38), combined with Theorem 6.6, shows that 
g € A(B) and that (37) holds. This completes the proof. 


Let us note the following special case: 
Take a(x) = x. Then B = g. Assume g’ € & on [A, B]. If Theorem 
6.17 is applied to the left side of (37), we obtain 


b B 
(39) [, £0) dx = | FOO) dy. 


INTEGRATION AND DIFFERENTIATION 
We still confine ourselves to real functions in this section. We shall show that 


integration and differentiation are, in a certain sense, inverse operations. 


6.20 Theorem Let fe # on [a,b]. Fora <x <b, put 


F(x) = ik f(t) dt. 


Then F is continuous on [a, b]; furthermore, if f is continuous at a point Xo of 
[a, b], then F is differentiable at xo, and 


F'(Xo) = f(%o). 
Proof Since fe @, f is bounded. Suppose |f(‘)| < M for a<t<b. 
ras x= jee 5, then 


|F(y) — FQX)| = < M(y — x), 


[so dt 


by Theorem 6.12(c) and (d). Given € > 0, we see that 
|F(y) — F()| <2, 
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provided that |y—x|<e/M. This proves continuity (and, in fact, 
uniform continuity) of F. 
Now suppose / is continuous at x9. Given ¢ > 0, choose 6 > 0 such 


that 
f(t) —f(%o0)| <e 
if |f — x9| <6, anda<t<b. Hence, if 
Xp ~O<SS XQ SHK<XQ+8 and Ges <1 0, 
we have, by Theorem 6.12(d), 


F(t) — F(s) 
t— 


It follows that F’(xo) = f(Xo). 


— f(Xo)] du} < «. 


— f(x o|=|— 


6.21 The fundamental theorem of calculus Jf f € # on [a, b] and if there is 
a differentiable function F on [a, b) such that F' =f, then 


{ " flos) dx = F(b) — F(a). 


Proof Let « >0 be given. Choose a partition P = {xo, ..., x,} of [a, 5] 
so that U(P, f) — L(P, f) < &. The mean value theorem furnishes points 
t; € [x;-,, x;] such that 


F(x;) — F(x;-1) = f(t) Ax; 
fer i= 1,...,77. ‘Tis 
Y fits) Ax; = Fl) — Fla). 
It now follows from Theorem 6.7(c) that 


<6; 


b 
F(b) — F(a) — ir fx) dx 


Since this holds for every ¢ > 0, the proof is complete. 


6.22 Theorem (integration by parts) Suppose F and G are differentiable func- 
tions on [a, b], F’ = fe &, and G'’ =geRB. Then 


[. Fedg(a) dx = F(b)G(b) - F(@)G(a) — [ Welw 


Proof Put H(x) = F(x)G(x) and apply Theorem 6.21 to H and its deriv- 
ative. Note that H’ € &, by Theorem 6.13. 
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INTEGRATION OF VECTOR-VALUED FUNCTIONS 


6.23 Definition Let /,,..., /, be real functions on (a, bj, and let f = (ff, ..., f,) 
be the corresponding mapping of [a, 6] into R*. If « increases monotonically 
on (a, 5], to say that f €e A(a) means that f; € A(a) forj=1,...,k. If this is the 


case, we define 
b b b 
[tae = (fdas... J fday, 


“a 


In other words, {f dx is the point in R* whose jth coordinate is [f; da. 

It is clear that parts (a), (c), and (e) of Theorem 6.12 are valid for these 
vector-valued integrals; we simply apply the earlier results to each coordinate. 
The same ts true of Theorems 6.17, 6.20, and 6.21. To illustrate, we state the 
analogue of Theorem 6.21. 


6.24 Theorem [ff and F mup [a. b] into R*, iff € & on [a, b], and if F’ = f, then 
b 
[ fer) dt = F(b) — F(a). 


The analogue of Theorem 6.13(4) offers some new features, however, at 
least 1n its proof. 


6.25 Theorem [ff maps [a, b] into R* and if f € Aa) for some monotonically 
increasing function « on [a, b], then |\f| € R(a), and 


b b 
(40) [ fdal < | || do. 
Proof If/,,...,/, are the components of f, then 
(41) If] = (ft + + 492)". 


By Theorem 6.11, each of the functions f; belongs to A(a); hence so does 
their sum. Since x? is a continuous function of x, Theorem 4.17 shows 
that the square-root function is continuous on [0, M], for every real M. 
If we apply Theorem 6.11 once more, (41) shows that |f| € A(a). 

To prove (40), put y = (j;,..-, 4%), Where y; = [f, da. Then we have 
y = ff da, and 


yi? = T= Ly, [hde=] yf) 


By the Schwarz inequality, 
(42) > St) s lyf] = (ast sd); 
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hence Theorem 6.12(b) implies 


(43) lyl?-< ly| { |e] de. 


If y = 0, (40) is trivial. If y #0, division of (43) by |y| gives (40). 


RECTIFIABLE CURVES 


We conclude this chapter with a topic of geometric interest which provides an 
application of some of the preceding theory. The case k = 2 (i.e., the case of 
plane curves) is of considerable importance in the study of analytic functions 
of a complex variable. 


6.26 Definition A continuous mapping y of an interval [a, b] into R* is called 
a curve in R*. To emphasize the parameter interval [a, b], we may also say that 
y is a curve on [a, b]. 


If y is one-to-one, y is called an arc. 
If (a) = y(b), y is said to be a closed curve. 


It should be noted that we deiine a curve to be a mapping, not a point set. 
Of course, with each curve y in R* there is associated a subset of R*, namely 
the range of y, but different curves may have the same range. 

We associate to each partition P = {x9,..., x,} of [a,b] and to each 
curve y on [a, 5] the number 


AP.) = ¥ lve) = vex. 


The ith term in this sum is the distance (in R*) between the points y(x;_,) and 
y(x;). Hence A(P, y) is the length of a polygonal path with vertices at (xo), 
y(x,),-..-, y(x,), In this order. As our partition becomes finer and finer, this 
polygon approaches the range of y more and more closely. This makes it seem 
reasonable to define the length of y as 


A(y) = sup A(P, ¥), 


where the supremum is taken over all partitions of [a, 5]. 

If A(y) < 0, we say that y is rectifiable. 

In certain cases, A(y) is given by a Riemann integral. We shall prove this 
for continuously differentiable curves, i.e., for curves y whose derivative y’ is 
continuous. | 
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6.27 Theorem [f/f ' is continuous on [a, b], then y is rectifiable, and 
, 
AQ) = J ly'@| de 
Proof Ifa<x;_, <x, < 5, then 


xd — xl =f Oar 


< | | y'(e)| dt. 


xi 


Hence 
b 
ACP, 9) < f Lyla 
for every partition P of [a, b]. Consequently, 
: , 
A(y) < I. | y'(t)| dt. 
To prove the opposite inequality, let ¢ >0 be given. Since y’ is 
uniformly continuous on [a, 5], there exists 6 > 0 such that 
ly(s)-—y(D|<e if |s—t| <6. 
Let ‘P = {x ,..., x,} be a partition of [a, b], with Ax; <6 for all i. If 
X;-; <t<.x;, it follows that 
ly(O| s ly’ Gp +. 
Hence 
[Wl des |y'@p| Ax +e Ax, 


= | [ YO+Ye)-7O) a +6 Ax, 


< + € Ax; 


+[[" eo vold 


{ . y'(t) dt 
7X) = We, + Qe Ax,. 
If we add these inequalities, we obtain 
5 
f lv@l aes AG, 9) + 26 - @) 


< A(y) + 2€(6 — a). 
Since € was arbitrary, 
b 
[ lvl at < AQ). 


This completes the proof. 
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EXERCISES 


1. Suppose « increases on [a, 6], a< x0 <b, « is continuous at xo, f(xo) = 1, and 
f(x) =0 if x # xo. Prove that fe A(«) and that f fd« = 0. 


b 
2. Suppose f> 0, f is continuous on [a, 6), and (i f(x) dx = 0. Prove thatsi@)= 0 


for all x € [a, b]. (Compare this with Exercise 1.) 

3. Define three functions B,, 82, Bs as follows: B,(x) =0 if x <0, B(x) =1 if x >0 
for j = 1, 2, 3; and 8,(0) = 0, 8.(0) =1, B3(0) = 3. Let f be a bounded function on 
{[—1, 1]. 

(a) Prove that fe A(B,) if and only if f(0+-) = f(0) and that then 


[ £48, =f). 


(b) State and prove a similar result for 2. 
(c) Prove that fe A(B;) if and only if f is continuous at 0. 
(d) If fis continuous at 0 prove that 


[ £48, = | faBs = | 48s = S00). 


4. If f(x) = 0 for all irrational x, f(x) = 1 for all rational x, prove that f¢ & on[a, b] 
for anya <b. 

5. Suppose f is a bounded real function on [a, 5], and f? ¢ # on [a, b}. Does it 
follow that fe #? Does the answer change if we assume that f* « #? 

6. Let P be the Cantor set constructed in Sec. 2.44. Let f be a bounded real function 
on [0, 1] which is continuous at every point outside P. Prove that f € #@ on (0, 1). 
Hint: P can be covered by finitely many segments whose total length can be made 
as small as desired. Proceed as in Theorem 6.10. 

7. Suppose f is a real function on (0, 1] and fe & on [c, 1] for every c > 0. Define 


[00 ae = tim [ feo ae 


if this limit exists (and is finite). 


(a) If fe & on (0, 1], show that this definition of the integral agrees with the old 
one. 


(6) Construct a function f such that the above limit exists, although it fails to exist 
with | f| in place of f. 
8. Suppose f€ # on [a, b] for every b >a where a is fixed. Define 


(2) b 
{ fo) dx = lim | f(x) dx 
e b~ Dg 
if this limit exists (and is finite). In that case, we say that the integral on the left 


converges. If it also converges after f has been replaced by | /]|, it is said to con- 
verge absolutely. 


10. 
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Assume that f(x) >0 and that f decreases monotonically on [1, 00). Prove 
that 


i f(x) dx 
1 
converges if and only if 

2 me) 


converges. (This is the so-called “integral test’? for convergence of series.) 


. Show that integration by parts can sometimes be applied to the ‘“improper’”’ 


integrals defined in Exercises 7 and 8. (State appropriate hypotheses, formulate a 
theorem, and prove it.) For instance show that 


ott. Lao 


ia cos x ° Six 


Show that one of these integrals converges absolutely, but that the other does not. 


Let p and q be positive real numbers such that 
r wl 
-+-=1., 
oF 
Prove the following statements. 
(a) If u>0 and v >0, then 
Pp q 
uv <= ~ a inl 
Pp q 


Equality holds if and only if u? = v*. 
(b) If fe R(«), 9g € R(a), f>0, g =>0, and 


‘ —_—— fo i. 
then 
[ fo desi, 


(c) If fand g are complex functions in #(«), then 


< if isla) {f lal* de| 


This is Hélder’s inequality. When p=q=2 it is usually called the Schwarz 
inequality. (Note that Theorem 1.35 is a very special case of this.) 

(d) Show that Hdlder’s inequality is also true for the “improper’’ integrals de- 
scribed in Exercises 7 and 8. 


[fade 
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11. Let « be a fixed increasing function on [a, 6]. For u € @(«), define 


bd 1/2 
lella = if |u|? ae] : 


Suppose f, g, h € @(a), and prove the triangle inequality 
If — Alla < WIF—glla + lig — All2 


as a consequence of the Schwarz inequality, as in the proof of Theorem 1.37. 
12. With the notations of Exercise 11, suppose fe M(«) and «€>0. Prove that 
there exists a continuous function g on (a, 6} such that ||f—g||. <e. 
Hint: Let P= {xo,..., Xn} be a suitable partition of [a, 5), define 


—— 


a(t)=— = fee pee f(x) 


iP Bins <== i. 
13. Define 
x+1 


fe | sin (1?) dt. 


(a) Prove that | f(x)| < 1/x if x >0. 
Hint: Put t? = u and integrate by parts, to show that f(x) is equal to 


cos (x?) cos [(x + 1)?] _ ‘> COS u 
2x 2(x + 1) we 4u3/2 


Replace cos u by —1. 
(b) Prove that 


2xf(x) = cos (x?) — cos [(x + 1)?] + r(x) 


where |r(x)| < c/x and c is a constant. 
(c) Find the upper and lower limits of xf(x), as x > ©. 


(d) Does | | sin (t?) dt converge? 
14. Deal similarly with 


pn f  Mcuienete. 


Show that 


e*| f(x)| <2 
and that 
e*f(x) = cos (e*) — e~' cos (e**') + r(x), 


where |r(x)| < Ce~*, for some constant C. 


as. 


16. 


17. 


18. 
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Suppose / is a real, continuously differentiable function on [a, 5], f(a) = f(b) = 0, 
and 


[re bem: 
Prove that 
[ xf00f') dx = -4 


and that 


[cor de: [ere de> 


For 1 <5 < o™, define 


(s)= n=1 = 


(This is Riemann’s zeta function, of great importance in the study of the distri- 
bution of prime numbers.) Prove that 


(a) Us)=s [ BY ax 
and that 
es =x — [x] 
eo &)=-——* i} qiar 4X, 


where [x] denotes the greatest integer < x. 

Prove that the integral in (6b) converges for all s > 0. 

Hint: To prove (a), compute the difference between the integral over [1, N] 
and the Mth partial sum of the series that defines Z(s). 
Suppose a increases monotonically on [a, 5], g is continuous, and g(x) = G(x) 
fora<x<b. Prove that 


| til iii, Sata daa, { “Gilt. 


Hint: Take g real, without loss of generality. Given P = {xo, x1,..., Xn}; 
choose #, € (x: -1, x:) so that g(t,) Ax; = G(x.) — G(x, -1). Show that 


¥ aldol) Linon — Geel — ¥ G(x; .,) Aen. 


Let y:, ¥2, v3 be curves in the complex plane, defined on [0, 277] by 
mi(th=e", = -yalt)=e7", vat) = ee ON. 


Show that these three curves have the same range, that y,; and y, are rectifiable, 
that the length of y, is 27, that the length of y,. is 47, and that y; is not rectifiable. 
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19. Let y; be a curve in R*, defined on [a, 5]; let be a continuous I-1 mapping of 
[c, d] onto [a, 6], such that ¢(c) = a; and define y2(s) = y:(¢(s)). Prove that y, is 
an arc, a closed curve, or a rectifiable curve if and only if the same is true of y,. 
Prove that y. and y, have the same length. 


7 


SEQUENCES AND SERIES OF FUNCTIONS 


In the present chapter we confine our attention to complex-valued functions 
(including the real-valued ones, of course), although many of the theorems and 
proofs which follow extend without difficulty to vector-valued functions, and 
even to mappings into general metric spaces. We choose to stay within this 
simple framework in order to focus attention on the most important aspects of 
the problems that arise when limit processes are interchanged. 


DISCUSSION OF MAIN PROBLEM 


7.1. Definition Suppose {f,}, n= 1,2,3,..., is a sequence of functions 
defined on a set E, and suppose that the sequence of numbers { /,(.x)} converges 
for every x € E. We can then define a function / by 


(1) S (x) = lim f,(x) (x € E). 


n— oo 
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Under these circumstances we say that {/,} converges on E and that / is 
the Jimit, or the limit function, of { f,}. Sometimes we shall use a more descriptive 
terminology and shall say that “{f,} converges to f pointwise on E” if (1) holds. 
Similarly, if &f,(x) converges for every x € FE, and if we define 


Q) fe)= The) we) 


the function f is called the sum of the series Lf, . 

The main problem which arises is to determine whether important 
properties of functions are preserved under the limit operations (1) and (2). 
For instance, if the functions f, are continuous, or differentiable, or integrable, 
is the same true of the limit function? What are the relations between /, and /’, 
say, or between the integrals of f, and that of f? 

To say that fis continuous at x means 

fini) = 7a). 

Cox 
Hence, to ask whether the limit of a sequence of continuous functions is con- 
tinuous is the same as to ask whether 


(3) lim lim f,(t) = lim lim f,(0), 

t>~x no n—>ao t-~x 
i.e., whether the order in which limit processes are carried out is immaterial. 
On the left side of (3), we first let n + 00, then t+ x; on the right side, t + x 
first, then 1 — 00. 

We shall now show by means of several examples that limit processes 
cannot in general be interchanged without affecting the result. Afterward, we 
shall prove that under certain conditions the order in which limit operations 
are carried out is immaterial. 

Our first example, and the simplest one, concerns a “‘double sequence.” 


Td Wee «=Forn= 1,2, 3,..., mel, 2,3, ...s0ee 


m 
Sm in ‘ 
, m+n 
Then, for every fixed n, 
lim Sein = 1, 
so that 
(4) lim lim s,,, = 1. 


n~>co m-~* oO 
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On the other hand, for every fixed m, 


lim s,, , = 0, 


n> o 


so that 


(5) lim lim 5,,, = 0. 


m— ao no 


7.3 Example Let 


7 


cs (real Sel, 2, . 2D; 


SAX) = 


and consider 
72 


(6) (x) -* I(x) -> G¢xy" 


Since /,(0) = 0, we have f(0) = 0. For x # 0, the last series in (6) is a convergent 
geometric series with sum | + x? (Theorem 3.26). Hence 


(7) lee i ae om 


so that a convergent series of continuous functions may have a discontinuous 
sum. 


7.4 Example For m = 1, 2, 3,..., put 


Sn(X) = lim (cos m!nx)?". 


n-?> co 


When m!x is an integer, f,(x) = 1. For all other values of x, f(x) = 0. Now let 


f(x) = lim f,,(%). 


m-— oo 


For irrational x, f,,(x) = 0 for every m; hence f(x) = 0. For rational x, say 
x = p/q, where p and q are integers, we see that m!x is an integer if m > q, so 


that7(x) = 1. Hence 


P . 10 x irrational), 
(8) lim lim (cos m!nx)? “| . exannd). 


m— co no 


We have thus obtained an everywhere discontinuous limit function, which 
is not Riemann-integrable (Exercise 4, Chap. 6). 
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7.5 Example Let 


(9) fey - SE ae =n, 


Vn 


SO = limo) 0: 


no 


and 


Then f(x) = 0, and 
LAs) = ay Nn COS HX, 


so that {f;} does not converge to f’. For instance, 


f(0) = ./n > +00 


as nm — 00, whereas f’(0) = 0. 


7.6 Example Let 
(10) fixy=n*xl — x?! (OS x <1, n= 1,2, 3)%..). 
For 0 < x < 1, we have 


lm f(x) = 0, 
by Theorem 3.20(d). Since f,(0) = 0, we see that 
(11) hinay(x) =0 O=< + =a): 
A simple calculation shows that 
1 
1 inn ——— 

I, x( x°)" dx oat a 

Thus, in spite of (11), 


n2 


2n +2 


++ 


[le ae = 


as n —> 00. 
If, in (10), we replace n? by n, (11) still holds, but we now have 


: n I 
li n d = li ee 
aa jf) wel Fo ae 
whereas 


fi | lim Zc) dx =0. 


n>@ 
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Thus the limit of the integral need not be equal to the integral of the limit, 
even if both are finite. 

After these examples, which show what can go wrong if limit processes 
are interchanged carelessly, we now define a new mode of convergence, stronger 
than pointwise convergence as defined in Definition 7.1, which will enable us to 
arrive at positive results. 


UNIFORM CONVERGENCE 


1.7 Definition We say that a sequence of functions {/,},” = 1, 2,3,..., 
converges wniformly on E to a function / if for every € > 0 there is an integer NV 
such that n > N implies 

(12) f(x) — f(x) | <e 

for all x € E. 

It is clear that every uniformly convergent sequence is pointwise con- 
vergent. Quite explicitly, the difference between the two concepts 1s this: If {f,} 
converges pointwise on E, then there exists a function f such that, for every 
e > 0, and for every x € E, there is an integer NV, depending on € and on x, such 
that (12) holds if n > N; if {7,} converges uniformly on E, it is possible, for each 
é > 0, to find one integer N which will do for all x € E. 

We say that the series Lf,(x) converges uniformly on E if the sequence 
{s,} of partial sums defined by 


Ms: 


Fi) = 5y(2) 


i=1 
converges uniformly on E. 
The Cauchy criterion for uniform convergence is as follows. 


7.8 Theorem The sequence of functions {f,}, defined on E, converges uniformly 
on E if and only if for every ¢ >0 there exists an integer N such that m> N, 
n> WN, x € E implies 


(13) [fu(x) — Sm(x) | < . 


Proof Suppose {f,} converges uniformly on E, and let f be the limit 
function. Then there is an integer N such that n > N, x € E implies 


Lf) - F091 <5, 
so that 
0d) — S001 < fil) — £091 + IFC) — Sm) | Se 


ifn>N,m>N,xee€E. 
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Conversely, suppose the Cauchy condition holds. By Theorem 3.11, 
the sequence { f,(x)} converges, for every x, to a limit which we may call 


f(x). Thus the sequence { /,} converges on E, to f. We have to prove that 
the convergence is uniform. 


Let ¢ > 0 be given, and choose N such that (13) holds. Fix m, and 
let m — o0 in (13). Since f(x) > f(x) as m— oo, this gives 


(14) lx) - (0) | <e 


for every n > N and every x € E, which completes the proof. 
The following criterion is sometimes useful. 


7.9 Theorem Suppose 


lim f,(x) =f(x) (x € E). 


Put 
M, = a HOY — FCSN. 


Then f, - f uniformly on E if and only if M, +0 asn—- oo. 


Since this is an immediate consequence of Definition 7.7, we omit the 
details of the proof. 


For series, there is a very convenient test for uniform convergence, due to 
Weierstrass. 
7.10 Theorem Suppose { f,} is a sequence of functions defined on E, and suppose 
\Ku(x) | onde (xe Boni Iy2)3,;.. 3) 
Then Xf, converges uniformly on E if &M,, converges. 


Note that the converse is not asserted (and is, in fact, not true). 


Proof If 2M, converges, then, for arbitrary ¢ > 0, 


LAC 


<}M,<e (x e£), 


provided m and n are large enough. Uniform convergence now follows 
from Theorem 7.8. 
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UNIFORM CONVERGENCE AND CONTINUITY 


7.11 Theorem Suppose f, — f uniformly on a set E in a metric space. Let x be 
a limit point of E, and suppose that 


(15) lane) —) a (en 
Then {A,} converges, and 
(16) pa = lim A,. 
In other words, the conclusion is ine 
(17) nae lim f,(¢) = lim Bewnfilit). 


Proof Let ¢>0 be given. By the uniform convergence of {/,}, there 
exists N such that n > N,m > N,t € E imply 


(18) |fn(t) —Sm(t) | < 8. 
Letting t > x in (18), we obtain 
|A, aa As | SE 


for n>N,m2>N, so that {A,} is a Cauchy sequence and therefore 
converges, say to A. 
Next, 


(19) IfO- Als IfO-FCO] + If — Anal + [An — Al. 
We first choose 7 such that 
(20) IO -F01 <5 
for all t € E (this is possible by the uniform convergence), and such that 
(21) |4,—A| <3" 
Then, for this 7, we choose a neighborhood V of x such that 
(22) Al) = Anal $5 


if te V ewB, tee. 
Substituting the inequalities (20) to (22) into (19), we see that 


If() — A| Se, 
provided te V0 E, t#x. This is equivalent to (16). 
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7.12 Theorem /f{/f,} is a sequence of continuous functions on E, and if f,— f 
uniformly on E, then f is continuous on E. 


This very important result is an immediate corollary of Theorem 7.11. 

The converse is not true; that is, a sequence of continuous functions may 
converge to a continuous function, although the convergence is not uniform. 
Example 7.6 is of this kind (to see this, apply Theorem 7.9). But there is a case 
in which we can assert the converse. 


7.13 Theorem Suppose K is compact, and 


(a) {f,} is a sequence of continuous functions on K, 
(b) {f,} converges pointwise to a continuous function f on K, 
@. fix) > faalx) fomal eR, neat, 2... 

Then f,, +f uniformly on K. 


Proof Put g,=/,—/. Then g, is continuous, g,—-0 pointwise, and 
Gn =9n+1- We have to prove that g, +0 uniformly on K. 

Let e >0 be given. Let K,, be the set of all xe K with g,(x) >. 
Since g,, is continuous, K,, is closed (Theorem 4.8), hence compact (Theorem 
2.35). Since g, > Gn+1, WOHURVE K, > K,,.,. Fie eek. Since ge) 0, 
we see that x ¢ K, if n is sufficiently large. Thus x ¢ (| K,. In other words, 
() K,, is empty. Hence Ky is empty for some N (Theorem 2.36). It follows 
that 0 <g,(x) < ¢ for all x € K and for alln > N. This proves the theorem. 


Let us note that compactness is really needed here. For instance, if 


Inlx) = nx + 1 


then /,(x) ~ 0 monotonically in (0, 1), but the convergence is not uniform. 


(0.< % <a 2, 3a) 


7.14 Definition If X is a metric space, @(X ) will denote the set of all complex- 
valued, continuous, bounded functions with domain _X. 


{Note that boundedness is redundant if Y is compact (Theorem 4.15). 
Thus @(X) consists of all complex continuous functions on X if X is compact. ] 
We associate with each f € @(X) its supremum norm 


Ifll = pe f(x) |. 
Since f is assumed to be bounded, ||f||< 00. It is obvious that || f|| = 0 only if 
JS (x) = 0 for every x € X, that is, only if f=0. Ifh =f+g, then 
|A(x)| < |f0)| + lo@)] < If + gl 
for all x e X; hence 


If+gll < If + lal. 
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If we define the distance between fe G(X) and g € G(X) to be ||f— gl, 


it follows that Axioms 2.15 for a metric are satisfied. 


We have thus made @(X) into a metric space. 
Theorem 7.9 can be rephrased as follows: 


A sequence {f,} converges to f with respect to the metric of @(X) if and 
only if f, +f uniformly on X. 


Accordingly, closed subsets of @(X) are sometimes called uniformly 


closed, the closure of a set & < G(X) is called its uniform closure, and so on. 


7.15 Theorem The above metric makes @(X) into a complete metric space. 


Proof Let {/,} be a Cauchy sequence in @(X). This means that to each 
€ >0 corresponds an WN such that ||f, —f,|| <ée if n>MN and m>N. 
It follows (by Theorem 7.8) that there is a function f with domain X to 
which {f,} converges uniformly. By Theorem 7.12, f is continuous. 
Moreover, f is bounded, since there is an n such that | f(x) —f,(x)| <1 
for all x € X, and f, is bounded. 
Thus fe@(X), and since f,-f uniformly on X, we have 

fal — © aie oo. 


UNIFORM CONVERGENCE AND INTEGRATION 


7.16 Theorem Let a be monotonically increasing on [a,b]. Suppose f, € A(a) 
on [a, b], forn = 1, 2, 3, ..., and suppose f,, + f uniformly on [a, b]. Then f € (a) 
on [a, b), and 


(23) 


aD 
| fda =lim 


a noo 


| e do. 


(The existence of the limit is part of the conclusion.) 


(24) 


(25) 


Proof It suffices to prove this for real f,. Put 
€, = Sup if.(50) To) l, 


the supremum being taken over a <x <b. Then 


ie nally F Fis 
so that the upper and lower integrals of f (see Definition 6.2) satisfy 


[u, — &,) da < | fade <[rda<f(, + €,) da. 


Hence 


O< { fda —| fda < 2eqa(b) — a(a)], 
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Since €, +0 as n— co (Theorem 7.9), the upper and lower integrals of f 
are equal. 
Thus f € &(a). Another application of (25) now yields 
b b 
(26) | [ fda-| f,du| <e,fa(b) — a(a)]. 


This implies (23). 


Corollary If, € #(a) on [a, b] and if 
f= he) (@s<xsd) 
the series converging uniformly on [a, 6], then 
b 9) b 
{ fdx= a) Sf, da. 


In other words, the series may be integrated term by term. 


UNIFORM CONVERGENCE AND DIFFERENTIATION 


We have already seen, in Example 7.5, that uniform convergence of { f,} implies 
nothing about the sequence { {7}. Thus stronger hypotheses are required for the 
assertion that f’ > f' if f, > /. 

7.17 Theorem Suppose { f,} is a sequence of functions, differentiable on |a, b] 


and such that {f,(xo)} converges for some point x. on [a, b]. If {f,} converges 
uniformly on [a, b], then {f,} converges uniformly on [a, b], to a function f, and 


(27) S’'@= limg,) (@= x ="). 
Proof Let ¢ > 0 be given. Choose N such that n > N, m > N, implies 
E 
(28) [fa(%o) — Sn(%o) | 5 


and 


(29) FO =O <= — ma 5 (a<t<b). 


SEQUENCES AND SERIES OF FUNCTIONS 153 


If we apply the mean value theorem 5.19 to the function f, — /,,, (29) 
shows that 


|x — tle 
(30) LA) eal) — SLD Seal) bs Wi — a) #2 


for any x and ¢ on [a, db], ifn > N,m2>N. The inequality 
ful) — Sl) 1 SU fx0) — Sm) — fnl%0) + Sn(%o) | + |Sn%0) — Sm(%o) | 
implies, by (28) and (30), that 
f(x) — f(x) |< (aan b,n> N,m> N), 
so that {f,} converges uniformly on [a, b]. Let 


F(x) =m, (x) (a<x <b). 


Let us now fix a point x on [a, b] and define 


(31) eu ee Snlt) = ful) hear a — f(x) 


ar = 


for@iat<byt¥#x. Then 


(32) lim ¢,(t) = f, 0) = 1,2 3, «.). 
The first inequality in (30) shows that 
E 
l(t) — Pm(2) | = a (n=>N,m2N), 


so that {¢,} converges uniformly, for t # x. Since { f,} converges to /, we 
conclude from (31) that 


(33) lim (1) = @(1) 


uniformly fora <1<b,t# x. 
If we now apply Theorem 7.11 to {¢,}, (32) and (33) show that 


lim #(t) = lim f,(x); 
ex avn 
and this is (27), by the definition of (1). 


Remark: If the continuity of the functions /, is assumed in addition to 
the above hypotheses, then a much shorter proof of (27) can be based on 
Theorem 7.16 and the fundamental theorem of calculus. 
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7.18 Theorem There exists a real continuous function on the real line which is 
nowhere differentiable. 


Proof Define 
(34) fr) =» || (-Il<x<1) 

and extend the definition of p(x) to all real x by requiring that 
(35) p(x + 2) = g(x). 

Then, for all s and f, 


(36) lp(s) — p(t) | < |s—t]. 
In particular, yg is continuous on R’. Define 


G37) fx) = ¥ @ot4"s), 


Since 0<@ <1, Theorem 7.10 shows that the series (37) converges 
uniformly on R’. By Theorem 7.12, f is continuous on R'. 
Now fix a real number x and a positive integer m. Put 


(38) om = +44" 


where the sign is so chosen that no integer lies between 4x and 4"(x + 6,,). 
This can be done, since 4” |6,,| = 4. Define 


(4"(x + On)) — (4"x) 
(39) _—_ oes oe ; 
When n > m, then 4"6,, is an even integer, so thaty, =0. When0 <n <m, 
(36) implies that |y, | <4". 
Since |y,, | = 4”, we conclude that 
m 3 n 
» (3) . 


I(x + Om) — £2) 


Om 
> 3" "53" 
n=0 
=O We 


Asm- oo, 6,,20. It follows that fis not differentiable at x. 


EQUICONTINUOUS FAMILIES OF FUNCTIONS 


In Theorem 3.6 we saw that every bounded sequence of complex numbers 
contains a convergent subsequence, and the question arises whether something 
similar is true for sequences of functions. To make the question more precise, 
we shall define two kinds of boundedness. . 
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7.19 Definition Let {/,} be a sequence of functions defined on a set E. 

We say that{f,} is pointwise bounded on E if the sequence { f,,(x)} is bounded 
for every x € E, that is, if there exists a finite-valued function @ defined on E 
such that 


fnl(x) | < d(x) (Ce Sie re a 


We say that {/,} is uniformly bounded on E if there exists a number M 
such that 


fix)l<M  (xeE,n=1,2,3,...). 


Now if {f,} is pointwise bounded on E and E, is a countable subset of E, 
it is always possible to find a subsequence {f,,} such that {f;,(x)} converges for 
every x € E,. This can be done by the diagonal process which is used in the 
proof of Theorem 7.23. 

However, even if {/,} is a uniformly bounded sequence of continuous 
functions on a compact set E, there need not exist a subsequence which con- 
verges pointwise on E. In the following example, this would be quite trouble- 
some to prove with the equipment which we have at hand so far, but the proof 
is quite simple if we appeal to a theorem from Chap. 11. 


7.20 Example Let 
S(x)=sinnx 0<x<2r,n=1,2,3,...). 


Suppose there exists a sequence {n,} such that {sin ,x} converges, for every 
x €[0, 27x]. In that case we must have 


lim (sin n,x — sina s,x)=0 (O0< x <2n); 


koa 
hence 
(40) lim (sin n,x — sinny,,;x)? =0 (<x <2z). 
k~>2 


By Lebesgue’s theorem concerning integration of boundedly convergent 
sequences (Theorem 11.32), (40) implies 


2n 

(41) lim \ (sin 1.x — sin m,,,x)* dx = 0. 
k+ao*O 

But a simple calculation shows that 


2n 
| (sin nx — sin m4,x)* dx = 2x, 
0 


which contradicts (41). 
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Another question is whether every convergent sequence contains a 
uniformly convergent subsequence. Our next example will show that this 
need not be so, even if the sequence is uniformly bounded on a compact set. 
(Example 7.6 shows that a sequence of bounded functions may converge 
without being uniformly bounded; but it is trivial to see that uniform conver- 
gence of a sequence of bounded functions implies uniform boundedness.) 


7.21 Example Let 


x? 


x? + (1 — nx)? 
Then |f,(x)| <1, so that {f,} is uniformly bounded on [0, !]. Also 
linia) 0 @ Garis!), 


n~ oO 


Si(X) = (0<x<l1,n=1,2,3,...). 


but 


f(-) =1 (p= 4,2, 3 er); 
n 


so that no subsequence can converge uniformly on [0, 1]. 


The concept which is needed in this connection is that of equicontinuity ; 
it is given in the following definition. 


7.22 Definition A family ¥ of complex functions f defined on a set F in a 
metric space X is said to be equicontinuous on E if for every ¢ > O there exists a 
6 > 0 such that 


Lf Gar— f@a |<< 


whenever d(x, ) <6, x € E, ye E, and fe ¥. Here d denotes the metric of X. 

It is clear that every member of an equicontinuous family is uniformly 
continuous. 

The sequence of Example 7.21 is not equicontinuous. 

Theorems 7.24 and 7.25 will show that there is a very close relation 
between equicontinuity, on the one hand, and uniform convergence of sequences 
of continuous functions, on the other. But first we describe a selection process 
which has nothing to do with continuity. 


7.23 Theorem /f{f,} is a pointwise bounded sequence of complex functions on 
a countable set E, then {f,} has a subsequence {f,,} such that {f,,(x)} converges for 
every x € E. 
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Proof Let {x,},i = 1, 2,3,..., be the points of E, arranged in a sequence. 
Since {f,(x,)} 1s bounded, there exists a subsequence, which we shall 
denote by {/, ,}, such that {f, ,(x,)} converges as k > oo. 

Let us now consider sequences S,, S,,.5;,..., which we represent 
by the array 


S.° hia fi Sis Siva 
So: fan Sra frais Sais 
Be: Ss Fo,2 Jaa Jose 


oe © (<cl78 "se © 8 8 © aie <« jena 6 «6 « 


and which have the following properties: 


(a) SS, iseaxsubsequence of S,_,, form = 2, 3,4,.... 

(6) {fiu(x,)} converges, as k—>0o (the boundedness of {/,(x,)} 

makes it possible to choose S, in this way); 

(c) The order in which the functions appear is the same in each se- 

quence; 1.e., if one function precedes another in S,, they are in the same 

relation in every S,, until one or the other is deleted. Hence, when 

going from one row in the above array to the next below, functions 

may move to the left but never to the right. 

We now go down the diagonal of the array; i.e., we consider the 
sequence 
S:abhe be See type '- 

By (c), the sequence S (except possibly its first »— 1 terms) is a sub- 
sequence of \S,, foren=l; 2,3y.... “Henee (6)"impliesmtiiat (7, ,(x;)} 
converges, as n > 00, for every x; € E. 


7.24 Theorem If K is a compact metric space, iff, € @(K) for n= 1, 2,3,..., 
and if{ f,} converges uniformly on K, then {f,} is equicontinuous on K. 


(42) 


(43) 


Proof Let ¢>0 be given. Since {f,} converges uniformly, there is an 
integer N such that 


Vu—Sull <6 — rae W). 


(See Definition 7.14.) Since continuous functions are uniformly con- 
tinuous on compact sets, there is a 6 > 0 such that 


fil) - fi) | < 


il aVeN ana atxyy) <e. 
If n> N and d(x, y) < 6, it follows that 


ful) — Li) | SCD — fv) | + fv) — fw 1 + [fv — fi) | < 3e- 


In conjunction with (43), this proves the theorem. 
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7.25 


Theorem Jf K is compact, if f, €@6(K) for n= 1, 2,3,..., and if {f,} is 


pointwise bounded and equicontinuous on K, then 


(44) 


(45) 


(46) 


(a) {f,} is uniformly bounded on K, 
(b) {f,} contains a uniformly convergent subsequence. 


Proof 


(a) Let ¢ >0 be given and choose 6 > 0, in accordance with Definition 
7.22, so that 


[fn(x) — Suv) | < € 


for all n, provided that d(x, y) < 6. 

Since K is compact, there are finitely many points p,,...,p, in K 
such that to every x e K corresponds at least one p; with d(x, p;) < 6. 
Since { f,} is pointwise bounded, there exist M/; < 00 such that |f,(p;)| < M; 
for all » If M=maw(%,,....™M.), then |fix)|<?/ +e fer eveny 
x € K. This proves (a). 
(b) Let E be a countable dense subset of K. (For the existence of such a 
set E, see Exercise 25, Chap. 2.) Theorem 7.23 shows that {f,} has a 
subsequence { f,,} such that { f,,(x)} converges for every x € E. 

Put f,, = 9;, to simplify the notation. We shall prove that {gj} 
converges uniformly on K. 

Let ¢ > 0, and pick 6 >0 as in the beginning of this proof. Let 
V(x, 6) be the set of all y € K with d(x, y) < 6. Since E is dense in K, and 
K is compact, there are finitely many points x,,..., x,, in E such that 


Ko V(x,,5) V+" U V(Xm, 5). 


Since {g,(x)} converges for every x € E, there is an integer N such 
that 


lg(x;) Te g (Xs) | <€ 


whenever i> N,j>N,1<s<m. 
If x € K, (45) shows that x € V(x,, 6) for some s, so that 


g(x) — 9x) | <e 
for every i. If i= N andj = N, it follows from (46) that 


g(x) — 9%) 1 S la) — gis) | + los) — 9x9) | + lolx.) — 9,00 | 
<me: 


This completes the proof. 
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THE STONE-WEIERSTRASS THEOREM 


7.26 Theorem I/f f is a continuous complex function on [a, b], there exists a 
sequence of polynomials P,, such that 


lim P,(x) = f(x) 
uniformly on [a, b]. If f is real, the P,, may be taken real. 


This 1s the form in which the theorem was originally discovered by 
Weierstrass. 


Proof We may assume, without loss of generality, that [u, 6] = [0, 1]. 
We may also assume that /(0) = f(1) = 0. For if the theorem is proved 
for this case, consider 


gle) =) — fO) — 21) —JO)» @sr2= 0). 


Here g(0) = g(|) = 0, and if g can be obtained as the limit of a uniformly 
convergent sequence of polynomials, it 1s clear that the same is true for /, 
since f — g is a polynomial. 

Furthermore, we define f(x) to be zero for x outside [0, 1]. Then f 
is uniformly continuous on the whole line. 

We put 


(47) O.(x) = cl — x?)" (1 = Fee... -); 
where c, is chosen so that 


(48) { Og =). Ge 2 Bes): 


We need some information about the order of magnitude of c,. Since 


1 


1 I/n 
[ a-xyav=2f (l= x?" dx 22h oe 
-1 (0) 0) 


vn 
>2f" (1 — nx?) dx 
0 
4 


- 3,/n 
| 


> es 
yn 


it follows from (48) that 


(49) Cn < Jn. 
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(50) 


(51) 


The inequality (1 — x?)">1— nx? which we used above is easily 
shown to be true by considering the function 


(1 — x?)"—1 4+ nx? 


which is zero at x = 0 and whose derivative is positive in (0, 1). 
For any 6 > 0, (49) implies 


0(x)</n(Ql-&y" (6 < [x] <1), 


so that Q0, > 0 uniformly in 6 < |x| <1. 
Now set 


1 
PAxy=[ flx+Q()d <x <I). 
~1 
Our assumptions about f show, by a simple change of variable, that 
1x 1 
P(xy=f f+ O(a =] [Ot — x) dt 
and the last integral is clearly a polynomial in x. Thus {P,} is a sequence 


of polynomials, which are real if f is real. 
Given € > 0, we choose 6 > 0 such that |y — x| < 6 implies 


I) - 41 <5: 


Let M =sup |f(x)|. Using (48), (50), and the fact that Q,(x) >0, we 
see that forO <x <1, 


Pao) —F0)!'= [f° UO +.) -FONlQWCD a 


1 
< | 


f(x + 1) — f(x) |Q,(t) at 

<2M { "O.(t)dt + ; { " Out) de + 2M { " O,(t) dt 
_ a é 

< 4M ./n (1 — 67)" + ; 


<€ 


for all large enough 1, which proves the theorem. 


It is instructive to sketch the graphs of Q, for a few values of 1; also, 


note that we needed uniform continuity of f to deduce uniform convergence 
of{ PsA. . 
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In the proof of Theorem 7.32 we shall not need the full strength of 
Theorem 7.26, but only the following special case, which we state as a corollary. 


7.27 Corollary For every interval [— a, a] there is a sequence of real poly- 
nomials P,, such that P,(0) = 0 and such that 
len Pix) =. [oe 


uniformly on [— a, a]. 


Proof By Theorem 7.26, there exists a sequence {P*} of real polynomials 
which converges to |x| uniformly on [— a, a]. In particular, P*(0) +0 
asn— 2. The polynomials 


PA SPR(x)— PFO) Ges bed, « .) 
have desired properties. 


We shall now isolate those properties of the polynomials which make 
the Weierstrass theorem possible. 


7.28 Definition A family o of complex functions defined on a set F is said 
to be an algebra if (i) f+ 9 € @. (il) fg € &. and (ili) cf Ee oA for all fe W,g € WA 
and for all complex constants c, that is, if «7 is closed under addition, multi- 
plication, and scalar multiplication. We shall also have to consider algebras of 
real functions; in this case, (ii!) is of course only required to hold for all real c. 

If sf has the property that fe. whenever f, €.7% (n = |, 2,3,...) and 
ft, 2f uniformly on E, then »7/ is said to be uniformly closed. 

Let Z be the set of all functions which are limits of uniformly convergent 
sequences of members of o&. Then # is called the wniform closure of s¥. (See 
Definition 7.14.) 

For example, the set of all polynomials is an algebra, and the Weierstrass 
theorem may be stated by saying that the set of continuous functions on {a, 4] 
is the uniform closure of the set of polynomials on [a, 5]. 


7.29 Theorem Let & be the uniform closure of an algebra sf of bounded 
functions. Then & is a uniformly closed algebra. 


Proof If fe ZB and ge @, there exist uniformly convergent sequences 
{f,},{gn; such that f, > f,g, >g and f, € 7,g, € . Since we are dealing 
with bounded functions, it is easy to show that 


Sn 4+GQn>f 49, Ln -9, of, Saas, 


where c is any constant, the convergence being uniform in each case. 
Hence f+ 9 € &, fg « B, and cfe ZB. so that ZB 1s an algebra. 
By Theorem 2.27, @ is (uniformly) closed. 


162 PRINCIPLES OF MATHEMATICAL ANALYSIS 


7.30 Definition Let » be a family of functions on a set E. Then s is said 
to separate points on E if to every pair of distincts point x,, x, € E there corre- 
sponds a function f € & such that f(x,) # /(x2). 

If to each x € E there corresponds a function g € & such that g(x) #0, 
we Say that of vanishes at no point of E. 

The algebra of all polynomials in one variable clearly has these properties 
on R'. An example of an algebra which does not separate points is the set of 
all even polynomials, say on [—1, 1], since f(— x) = f(x) for every even function /. 

The following theorem will illustrate these concepts further. 


7.31 Theorem Suppose sf is an algebra of functions on a set E, & separates 
points on E, and xf vanishes at no point of E. Suppose x,, x. are distinct points 
of E, and c,,c, are constants (real if sf is a real algebra). Then of contains a 
function f such that 


I(x) =e, I (x2) = ¢2. 


Proof The assumptions show that contains functions g,h, and k 
such that 


g(x;) # g(X2), h(x,) a 0, k(x2) # 0. 


Put 
u=gk—g(x,)k, v=gh—g(x,)h. 
Then ue S,v € A, u(x,) = v(x) = 0, u(x,) # 0, and v(x,) 4 0. Therefore 


C,v C2u 
ob 
v(x;) u(x>) 


f= 
has the desired properties. 


We now have all the material needed for Stone’s generalization of the 
Weierstrass theorem. 


7.32 Theorem Let x be an algebra of real continuous functions on a compact 
set K. If sf separates points on K and if xf vanishes at no point of K, then the 
uniform closure B of x consists of all real continuous functions on K. 


We shall divide the proof into four steps. 


sTeP 1 If fe@, then \f\ e@. 
Proof Let 
(52) a=sup |f(x)| (xeXK) 
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and let ¢ >0 be given. By Corollary 7.27 there exist real numbers 
Cy, -.%, ¢, euch that 


(53) (-a<sy<a). 


dew — |ly||<e 


Since # is an algebra, the function 


=5'c,f' 


is a member of @. By (52) and (53), we have 
la) - @\[<e eX). 
Since # is uniformly closed, this shows that |f| € @. 


sTeEP 2 If fe B@andg €@&, then max(f,g)€@ and min(f,g) €&@. 


By max (f, g) we mean the function h defined by 
nay <L@)— FFG) 2900, 
g(x) if f(x) < g(x), 
and min (f, g) is defined likewise. 


Proof Step 2 follows from step | and the identities 


aa If-g| 
7 


ee Lao 


max (f, 9) = 


By iteration, the result can of course be extended to any finite set 
of functions: If fi,...,/f,¢€@, then max (f;,...,/,)€@, and 


min (fj, ..-,/,)€ 2. 
STEP 3. Given a real function f, continuous on K, a point x € K, and & > 0, there 
exists a function g, € @ such that g(x) = f(x) and 
(54) gAt)>f(t)—e (eK). 


Proof Since #< @ and #& satisfies the hypotheses of Theorem 7.31 so 
does @. Hence, for every y € K, we can find a function h, € @ such that 


(55) h(x) =f), —-A,(y) = F0). 
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(56) 


(57) 


By the continuity of A, there exists an open set J,, containing y, 
such that 


hyft) > fi@). =e (t €J,). 
Since K is compact, there is a finite set of points y,,..., y, such that 
Ric dggiae - -ordgy 
Put 


G., SMART. .-- 5 Myg)- 


By step 2, g e &, and the relations (55) to (57) show that g, has the other 
required properties. 


STEP 4 Given a real function f, continuous on K, and € > 0, there exists a function 
h € B such that 


(58) 


|h(x) — f(x)| <e (x € K). 


Since @ is uniformly closed, this statement is equivalent to the conclusion 


of the theorem. 


(59) 


(60) 


(61) 


(62) 


Proof Let us consider the functions g,, for each x € K, constructed in 
step 3. By the continuity of g,, there exist open sets V, containing x, 
such that 


9.19 <fO Te We V,). 


Since K is compact, there exists a finite set of points x,,...,X,, 
such that 


1 a | 
Put 
P= MING .> - -.<siiee)- 

By step 2, h € @, and (54) implies 

A(t) >f()—e (tek), 
whereas (59) and (60) imply 

h(t) < f(t) + € (te K). 
Finally, (58) follows from (61) and (62). 
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Theorem 7.32 does not hold for complex algebras. A counterexample is 


given in Exercise 21. However, the conclusion of the theorem does hold, even 
for complex algebras, if an extra condition is imposed on ., namely, that 
be self-adjoint. This means that for every f € # its complex conjugate f must 


also belong to o; f is defined by f(x) = f(x). 


7.33 Theorem Suppose & is a self-adjoint algebra of complex continuous 
functions on a compact set K, & separates points on K, and sf vanishes at no 
point of K. Then the uniform closure @ of & consists of all complex continuous 
functions on K. In other words, of is dense @(K). 


Proof Let , be the set of all real functions on K which belong to #. 

If fe & and f = u + iv, with u, v real, then 2u = f + f, and since o& 
is self-adjoint, we see that we W,. If x, # x,, there exists fe of such 
that /(x,) = 1, f(x.) = 0; hence 0 = a@,) 4 u(x,) = 1, which shows that 
Wp Separates points on K. If x € K, then g(x) # 0 for some g € &#, and 
there is a complex number 7 such that Ag(x) > 0; if f=2g, f=u + iv, it 
follows that u(x) > 0; hence #, vanishes at no point of K. 

Thus #,p satisfies the hypotheses of Theorem 7.32. It follows that 
every real continuous function on K lies in the uniform closure of Wp, 
hence lies in @. If f is a complex continuous function on K, f= u +iv, 
then ue 2,v ef, hence fe BZ. This completes the proof. 


EXERCISES 


1. 


Prove that every uniformly convergent sequence of bounded functions is uni- 
formly bounded. 


. If {f,} and {g,} converge uniformly on a set E, prove that {(/, + gn} converges 


uniformly on E. If, in addition, {/,} and {g,} are sequences of bounded functions, 
prove that {f.g,} converges uniformly on E. 


. Construct sequences {/,}, {g.} which converge uniformly on some set E, but such 


that {f,9,} does not converge uniformly on E (of course, {/,g,.} must converge on 
EB). 


. Consider 


= l 
ey [ae 
fC ) 2 1 == Wx 
For what values of x does the series converge absolutely ? On what intervals does 
it converge uniformly? On what intervals does it fail to converge uniformly? I» / 
continuous wherever the series converges? Is f bounded? 
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Show that {/,} converges to a continuous function, but not uniformly. Use the 
series © f, to show that absolute convergence, even for all x, does not imply uni- 
form convergence. 

6. Prove that the series 


x?+hn 


> (-1" 


n=1 n? 


converges uniformly in every bounded interval, but does not converge absolutely 
for any value of x. 
he Fen = 1, 2, 3, . 4. ,xoorealpput 


fi.(x) = 


1+ nx?” 
Show that {/,} converges uniformly to a function f, and that the equation 
Sie= lim f(x) 
is correct if x #0, but false if x = 0. 
8. If 


_j0 (*<0), 
10) = (x > 0), 


if {x,} is a sequence of distinct points of (a, b), and if =|c,| converges, prove that 
the series 


i ay 2s (a la es) 


converges uniformly, and that fis continuous for every x # x,. 
9. Let {f,} be a sequence of continuous functions which converges uniformly to a 
function f on a set E. Prove that 


Tim fal») = 0) 


for every sequence of points x, € E such that x, > x, and x € E. Is the converse of 
this true? 


13. 


10. 


fi, 


w2, 
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Letting (x) denote the fractional part of the real number x (see Exercise 16, Chap. 4, 
for the definition), consider the function 
f(x) = Zz, “ (x real). 

Find all discontinuities of /, and show that they form a countable dense set. 
Show that / is nevertheless Riemann-integrable on every bounded interval. 
Suppose {fn}, {gn} are defined on E, and 
(a) Xf, has uniformly bounded partial sums; 
(6) gr > 90 uniformly on E; 
(c) 91(x) =92(x) > ga(x) >: ': for every xe E. 

Prove that © f,g, converges uniformly on £. Hint: Compare with Theorem 
3.42. 
Suppose g and f,(m = 1, 2, 3, ...) are defined on (0, ~), are Riemann-integrable on 
[t, 7] whenever 0< t< T<%, |f,| <9, f/f uniformly on every compact sub- 
set of (0, 00), and 


| g(x) dx < ow. 
0 


Prove that 


lim [  fa(x) dx = | foayar. 
Beg: a) 
(See Exercises 7 and 8 of Chap. 6 for the relevant definitions.) 

This is a rather weak form of Lebesgue’s dominated convergence theorem 
(Theorem 11.32). Even in the context of the Riemann integral, uniform conver- 
gence can be replaced by pointwise convergence if it is assumed that fe Z. (See 
the articles by F. Cunningham in Math. Mag., vol. 40, 1967, pp. 179-186, and 
by H. Kestelman in Amer. Math. Monthly, vol. 77, 1970, pp. 182-187.) 

Assume that {/,} is a sequence of monotonically increasing functions on R' with 
0</f,(x) <1 for all x and all 7. 
(a) Prove that there is a function f and a sequence {7,} such that 


fx) = im fal) 


for every x € R'. (The existence of such a pointwise convergent subsequence is 
usually called Helly’s selection theorem.) 
(b) If, moreover, f is continuous, prove that f,, > f uniformly on R’. 

Hint: (i) Some subsequence { /,,} converges at all rational points r, say, to 
f(r). (ii) Define f(x), for any x € R', to be sup /(r), the sup being taken over all 
r<x. (iii) Show that f,,(x) f(x) at every x at which / is continuous. (This is 
where monotonicity is strongly used.) (iv) A subsequence of {/,,} converges at 
every point of discontinuity of f since there are at most countably many such 
points. This proves (a). To prove (6), modify your proof of (ili) appropriately. 
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14. 


1S; 


16. 


1m 


18. 


9. 


Let f be a continuous real function on R' with the following properties: 
0< f(t) <1, f(t + 2) =f(t) for every t, and 
0 @O<r<) 
f= | 
1 (ae |e 


Put ®(t) = (x(t), y(t)), where 


x)= F2-YB"'), — =F 2-FO™0). 


Prove that ® is continuous and that ® maps J = (0, 1) onto the unit square J? < R?. 
If fact, show that ® maps the Cantor set onto /?. 
Hint: Each (xo, yo) € J? has the form 


Xo = 22 "aan-1; Yo = 22> "aan 


where each a, is 0 or 1. If 


to= 3 5 !="Qe) 
f=1 


show that f(3*to) = a,, and hence that x(to) = xo, (to) = Yo. 

(This simple example of a so-called ‘‘ space-filling curve’ is due to I. J. 
Schoenberg, Bull. A.M.S., vol. 44, 1938, pp. 519.) 
Suppose f is a real continuous function on R’, f,(t) = f(nt) for n=1, 2, 3,..., and 
{fn} is equicontinuous on [0, 1]. What conclusion can you draw about f? 
Suppose {/,} is an equicontinuous sequence of functions on a compact set K, and 
{f,} converges pointwise on K. Prove that {/,} converges uniformly on K. 
Define the notions of uniform convergence and equicontinuity for mappings into 
any metric space. Show that Theorems 7.9 and 7.12 are valid for mappings into 
any metric space, that Theorems 7.8 and 7.11 are valid for mappings into any 
complete metric space, and that Theorems 7.10, 7.16, 7.17, 7.24, and 7.25 hold for 
vector-valued functions, that is, for mappings into any R*. 
Let {f,} be a uniformly bounded sequence of functions which are Riemann-inte- 
grable on [a, b], and put 


reyes { fidudt  (@ssacilap 


Prove that there exists a subsequence {F,,} which converges uniformly on [a, 5]. 
Let K be a compact metric space, let 5 be a subset of @(K). Prove that S is compact 
(with respect to the metric defined in Section 7.14) if and only if S is uniformly 
closed, pointwise bounded, and equicontinuous. (If S is not equicontinuous, 
then .S contains a sequence which has no equicontinuous subsequence, hence has 
no subsequence that converges uniformly on K.) . 


20. 


2A. 


22. 
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If f is continuous on [0, 1] and if 
1 
| {Oa (2G, 4,%,......, 
ce) 


prove that f(x) = 0 on [0,1]. Hint: The integral of the product of f with any 
1 
polynomial is zero. Use the Weierstrass theorem to show that [, fweojdx —%:; 


Let K be the unit circle in the complex plane (i.e., the set of all z with |z| = 1), and 
let of be the algebra of all functions of the form 


fie S nang (6 real). 
n=0 


Then / separates points on K and .o/ vanishes at no point of K, but nevertheless 
there are continuous functions on K which are not in the uniform closure of ®&. 
Hint: For every fe 7 

w2k 
| flei)e'*. dd =0, 

bh 9 
and this is also true for every fin the closure of 27. 
Assume f€ A(«) on [a, b], and prove that there are polynomials P, such that 


lim | 1f— Pleilen— 6! 


(Compare with Exercise 12, Chap. 6.) 
Put P. = 0, and define, for n = 0, 1, 2,..., 
2 pz 
Pua 1(x) = Palx) + eels 


Prove that 
lim “Rees ="x|., 
uniformly on [—1, 1]. 
(This makes it possible to prove the Stone-Weierstrass theorem without first 


proving Theorem 7.26.) 
Hint: Use the identity 


lei rn 


|x|. — Prado =o lena = PAGO} 5 


to prove that 0 < P,(x) < Pa+i(x) < |x| if |x] <1, and that 
P <= ] = |x| j me ae 
ee |= n(x) < |x| 2 ie 2 | 

if |x|. 
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24. Let XY be a metric space, with metric d. Fix a point ae X. Assign to each pe X 
the function f, defined by 


Sx) = d(x, p)—d(x,a) (xe X). 


Prove that | /,(x)| <d(a, p) for all x € X, and that therefore f, € G(X). 
Prove that 
for all p,q Ee X. 
If D(p) = f, it follows that ® is an isometry (a distance-preserving mapping) 
of X onto ®(X) < G(X). 
Let Y be the closure of ®( XY) in €(X). Show that Y is complete. 
Conclusion: X is isometric to a dense subset of a complete metric space Y. 
(Exercise 24, Chap. 3 contains a different proof of this.) 
25. Suppose ¢ is a continuous bounded real function in the strip defined by 
0<x<1,-—w <y<o. Prove that the initial-value problem 


y= ¢(x,y), ywO=c 
has a solution. (Note that the hypotheses of this existence theorem are less stringent 
than those of the corresponding uniqueness theorem; see Exercise 27, Chap. 5.) 


Hint: Fix n. For i=0,...,m, put x, = i/n. Let f, be a continuous function 
on [0, 1] such that f,(0) = c, 


fh) =e. SAD = A wt <%),,, 
and put 
An(t) = fa(t) — H(t, fat), 
except at the points x,, where A,(t) = 0. Then 


fix) =e + { (BC, fA) + Dal) at 


Choose M < <x so that |¢| <M. Verify the following assertions. 


(a) |f.| <M, |4,| <2M, A, € B&, and | f,| <|c] + M=™M,, say, on [0, 1], for 
all 7. 

(b) {f,} is equicontinuous on (0, 1], since | f;| < M. 

(c) Some {f,,} converges to some f, uniformly on {0, 1). 

(d) Since ¢ is uniformly continuous on the rectangle O< x <1, |y| <M,, 


P(t, fax(t)) > df(t, f(t) 


uniformly on [0, 1]. 
(e) A,(t) > 0 uniformly on [0, 1], since 


A,(t) = P(x, fala) — H(t, felt) 


in (X1, X141)- 


26. 
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(/) Hence 
fixy=etf $f) at. 
0 
This / is a solution of the given problem. 
Prove an analogous existence theorem for the initial-value problem 


y’ = ®(x,y), y(0)=c, 


where now c € R‘, y € R*, and ® is a continuous bounded mapping of the part of 
R*‘*' defined by 0 < x <1, y € R* into R*. (Compare Exercise 28, Chap. 5.) Hint: 
Use the vector-valued version of Theorem 7.25. 


8 


SOME SPECIAL FUNC PIONS 


POWER SERIES 


In this section we shall derive some properties of functions which are represented 
by power series, i.e., functions of the form 


(1) f(x) = Y cyx” 
or, more generally, 
(2) F(x) =D eax — a)”. 


These are called analytic functions. 

We shall restrict ourselves to real values of x. Instead of circles of con- 
vergence (see Theorem 3.39) we shall therefore encounter intervals of conver- 
gence. 

If (1) converges for all x in (—R, R), for some R>O (R may be +00), 
we say that fis expanded in a power series about the point x = 0. Similarly, if 
(2) converges for |x — a| < R, fis said to be expanded in a power series about 
the point x = a. As a matter of convenience, we shall often take a = 0 without 
any loss of generality. 
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8.1 Theorem Suppose the series 

(3) ¥ cx" 

converges for |x| < R, and define 

(4) fxy= Fox" (Ix1<R), 


Then (3) converges uniformly on [—R+ &, R—€], no matter which ¢ > 0 
is chosen. The function f is continuous and differentiable in (— R, R), and 


(5) so = napa (|x| < R). 


Proof Let e>0 be given. For |x| < R—, we have 
|c,x"| < |e,(R — €)"|; 
and since 
Xc,(R —e)" 


converges absolutely (every power series converges absolutely in the 
interior of its interval of convergence, by the root test), Theorem 7.10 
shows the uniform convergence of (3) on [—R+ 6, R—- ¢]. 

Since "/n +1 as n+ 00, we have 

lim sup “/n\eq| = lim sup esl, 

so that the series (4) and (5) have the same interval of convergence. 

Since (5) 1s a power series, it converges uniformly in [—R+6, 
R — e], for every € > 0, and we can apply Theorem 7.17 (for series in- 
stead of sequences). It follows that (5) holds if |x| < R—e. 

But, given any x such that |x| < R, we can find an ¢ > 0 such that 
|x| < R—e. This shows that (5) holds for |x| < R. 

Continuity of f follows from the existence of f’ (Theorem 5.2). 


Corollary Under the hypotheses of Theorem 8.1, f has derivatives of all 
orders in (—R, R), which are given by 


fe) 


(6) f(x) = ¥ a —1) ++: (n— kk + De, x"™. 
n=k 
In particular, 
(7) fO) =k!  (k =0,1,2,...). 


(Here f means f, and f™ is the kth derivative of f, for k = 1, 2, 3,...). 
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Proof Equation (6) follows if we apply Theorem 8.1 successively to f. 
T'.f",.... Putting x = 0'%ANn @) we Gbtain (7). 


Formula (7) is very interesting. It shows, on the one hand, that the 
coefficients of the power series development of f are determined by the values 
of fand of its derivatives at a single point. On the other hand, if the coefficients 
are given, the values of the derivatives of f at the center of the interval of con- 
vergence can be,.read off immediately from the power series. 

Note, however. that although a function f may have derivatives of all 
orders, the series Lc, x", where c, is computed by (7), need not converge to f(x) 
for any x #0. In this case, fcannot be expanded in a power series about x = 0. 
For if we had f(x) = La, x", we should have 


nila, f™@). 
hence a, =c,. An example of this situation is given in Exercise 1. 

If the series (3) converges at an endpoint, say at x = R, then fis continuous 
not only in (— R, R), but also at x = R. This follows from Abel’s theorem (for 
simplicity of notation, we take R = 1): 

8.2 Theorem Suppose <Xc, converges. Put 
I) = Gg (a a 
n=0 
Then 


(8) lim f(x) = ¥ c,- 


5a 3} 


Proof = Letws,, =p + * eG, pep =O “Then 

m m m—1 

> 6,8 =) (a, —spey ae = — ae) > ay” + 5,2". 
n=0 n=0 


For |x| < 1, we let m— o and obtain 


(9) f(x) = 1 = 2) Y 55>". 
Suppose s = lim s,. Let ¢ >0 be given. Choose N so thatn > N 
nO 
implies 
Is—s,| <>. 


2 
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Then, since 
@) — aS heal (hee | 1); 
n=0 


we obtain from (9) 
foe) N £ 
f(x) — 5] =| — x) X (5, ~ 5)a"| < (1-2) Is — s[ aI" +5 <8 
n=0 n=0 


if x > 1 — 6, for some suitably chosen 6 > 0. This implies (8). 
As an application, let us prove Theorem 3.51, which dsserts: /f La,, Ld,, 
LC y:9 CONBENGC 10, dh, lie Cand if Cx =Gobeet °° PtrGebpy.themC = AB, We let 
[Oyo hime? lie) =} cyxt, 
n=0 n=0 n=0 


forO<x<1. For x <1, these series converge absolutely and hence may be 
multiplied according to Definition 3.48; when the multiplication is carried out, 
we see that 


(10) f(x) g(x) =x) = (OS x< 1). 
By Theorem 8.2, 
(11) f(x)7 4,  gx)>B, Ax)-c 


as x +1. Equations (10) and (11) imply AB = C. 
We now require a theorem concerning an inversion in the order of sum- 
mation. (See Exercises 2 and 3.) 


8.3 Theorem Given a double sequence {a;,;}, i= 1, 2, 3, ..., j= 1, 2, 3, ..., 
suppose that 


(12) y la,|=b; (=1,2,3,..) 


and Xb; converges. Then 


(13) Z wae 2 2 at 


Proof We could establish (13) by a direct procedure similar to (although 
more involved than) the one used in Theorem 3.55. However, the following 
method seems more interesting. 
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Let E be a countable set, consisting of the points x9, x,, X,,..., and 
suppose x, >X 9 asSn—oo. Define 


(14) fi%o)= Seay @= 1,23. 
(15) fe) =Say (yn = 12,3...) 
(16) g(x)=) fie) (eB). 


Now, (14) and (15), together with (12), show that each f; is con- 
tinuous at x,. Since | f,(x)| < 6; for x € E, (16) converges uniformly, so 
that g is continuous at x, (Theorem 7.11). It follows that 


2 2 aij; = y filXo) = (Xo) = lin g(x,,) 


=lim¥ f(x,) = ti "2 a, 


n= 
fe 0) 


m 
io @) 

’ n oO 
=e Bay 2 


n~o j=li=l j=ii=1 


; 


a,j: 


8.4 Theorem Suppose 
f(x) = dn x 


the series converging in |x|< R. If —R<a< R, then f can be expanded ina 
power series about the point x = a which converges in |x —a|< R— |a|, and 


(n) 
(17) fix) = 3 


ay" age —tape R =a. 


This is an extension of Theorem 5.15 and is also known as TJaylor’s 
theorem. 


Proof We have 
f(x) = ¥ e,[(x — a) + al" 
n=0 


=F. $ (Merne—or 


m 


= . | 5 ("") cat] o— ay". 
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This is the desired expansion about the point x = a. To prove its validity, 
we have to justify the change which was made in the order of summation. 
Theorem 8.3 shows that this is permissible if 


n n-m m 
Ce (" a (Xu Gy 


converges. But (18) is the same as 


(18) = & 


n=0 m=0 


Ss 


(19) Y heal Ux —al + lly 
and (19) converges if |x — a] + |a|< R. 
Finally, the form of the coefficients in (17) follows from (7). 


It should be noted that (17) may actually converge in a larger interval than 
the one given by |x —a| < R— |a|. 

If two power series converge to the same function in (— R, R), (7) shows 
that the two series must be identical, 1.e., they must have the same coefficients. 
It is interesting that the same conclusion can be deduced from much weaker 
hypotheses: 


8.5 Theorem Suppose the series Xa, x" and Xb, x" converge in the segment 
S=(-—R, R). Let E be the set of all x € S at which 


(20) , ae — > he. 
n=0 n=0 
if E has a limit point in S, then a, = 6, forn =0, 1, 2,.... Hence (20) holds for 


allxeS. 


Proof Put c, =a, — 5, and 
(21) PACS oo yc, Xx" (-enS). 
n=0 


Then /(x) ="O'on E. 

Let A be the set of all limit points of E in S, and let B consist of all 
other points of S. It is clear from the definition of “limit point” that B 
is open. Suppose we can prove that A is open. Then A and B are disjoint 
open sets. Hence they are separated (Definition 2.45). Since S = Au B, 
and S is connected, one of A and B must be empty. By hypothesis, A 1s 
not empty. Hence B is empty, and A = S. Since f is continuous in S, 
AcE. Thus E = S, and (7) shows that c, = 0 for n = 0, 1, 2,..., which 
is the desired conclusion. 
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Thus we have to prove that A is open. If xp € A, Theorem 8.4 shows 
that 


(22) f(x) = Y dul — x0)" f| x — %o| < R— | xe|) 


We claim that d, = 0 for all n. Otherwise, let k be the smallest non- 
negative integer. such that d, #0. Then 


(23) f(x) = (x — Xo)‘g(®) — (|x — X0| < R- | xo), 
where 
(24) g(x) = os Cle — ragy. 


Since g is continuous at x, and 
g(Xo) = dy, # 0, 


there exists a 6 > 0 such that g(x) £0 if |x —x9|< 06. It follows from 
(23) that f(x) #0 if O< |x — x,| <6. But this contradicts the fact that 
Xo is a limit point of E. 

Thus d, = 0 for all n, so that f(x) = 0 for all x for which (22) holds, 
1.e., In a neighborhood of x9. This shows that A is open, and completes 
the proof. 


THE EXPONENTIAL AND LOGARITHMIC FUNCTIONS 
We define 


(25) Beye > 4 


n 


The ratio test shows that this series converges for every complex z. Applying 
Theorem 3.50 on multiplication of absolutely convergent series, we obtain 


nw" fo 6) n oky * 
= (2 +m 


n=0 n! 


which gives us the important addition formula 
(eo — E(z + w) = E(z)E(w) (z, w complex). 
One consequence is that 


(27) E(z)E(—z) = E(z—z)=E(@)=1 = (z complex). - 
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his shows that E(z) # 0 for all z. By (25), E(x) > 0 if x > 0; hence (27) shows 
that E(x) > 0 for all real x. By (25), E(x) + +00 as x + +00; hence (27) shows 
that E(x) +0 as x + — oo along the real axis. By (25), 0 <x < y implies that 
E(x) < E(y); by (27), it follows that E(—y) < E(— x); hence E is strictly in- 
creasing on the whole real axis. 

The addition formula also shows that 


am h)-—E E(h) - 1 

(28) lim Elz + &) —@@) = E(z) lim Eth) — 1 = E(z): 
h=0 h h=o 830A 

the last equality follows directly from (25). 

Iteration of (26) gives 

(29) Piz. + ---octgg, = Be.) Elz). 

Let us take z, = --: =z, = 1. Since E(1) =e, where e is the number defined 

in Definition 3.30, we obtain 

(30) EB@) = e Ur le2..3, ...): 

If p = n/m, where n, m are positive integers, then 

(31) [E(p)}!" = E(mp) = E(n) = e’, 

so that 

(32) E(p)=e? | (p> 0, p rational). 


It follows from (27) that E(—p) =e? if p is positive and rational. Thus (32) 
holds for all rational p. 
In Exercise 6, Chap. 1, we suggested the definition 


(33) x” ="supx?, 

where the sup is taken over all rational p such that p <3, for any real y, and 
x > 1. If we thus define, for any real x, 

(34) e* = supe? (p < x, p rational), 

the continuity and monotonicity properties of E, together with (32), show that 
(35) Ex o 


for all real x. Equation (35) explains why E ts called the exponential function. 
The notation exp (x) is often used in place of e*, expecially when x Is a 
complicated expression. 
Actually one may very well use (35) instead of (34) as the definition of e”; 
(35) is a much more convenient starting point for the investigation of the 
properties of e*. We shall see presently that (33) may also be replaced by a 
more convenient definition [see (43)]. 
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We now revert to the customary notation, e*, in place of E(x), and sum- 
marize what we have proved so far. 


8.6 Theorem Let e* be defined on R' by (35) and (25). Then 
(a) e* is continuous and differentiable for all x; 
(6) dey =e, 
(c) e* isa strictly increasing function of x, and e* > 0; 
@ =a 
(ec) e>+oasx>7+0,e>-0asx>-o; 
(f) lim,.,.x"e * = 0, fomeverpa. 
Proof We have already proved (a) to (e); (25) shows that 
xnt 1 
x = ae 
«amas 
for x > 0, so that 
ys 
— (n + 1) 
x 


x 


and (/) follows. Part (/) shows that e* tends to +00 “faster” than any 
power of x, as x > +00. 


Since E is strictly increasing and differentiable on R', it has an inverse 
function L which 1s also strictly increasing and differentiable and whose domain 
is E(R'), that is, the set of all positive numbers. L is defined by 


(36) ERO) — yao); 

or, equivalently, by 

(37) LE =x (x real). 

Differentiating (37), we get (compare Theorem 5.5) 
E(E@)) ede 1. 


Writing y = E(x), this gives us 
: l 
(38) L(y) 7% (y > 0). 
Taking x = 0 in (37), we see that L(1) = 0. Hence (38) implies 


ya 
(39) rey= FE 
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Quite frequently, (39) ts taken as the starting point of the theory of the logarithm 
and the exponential function. Writing u = E(x), v = E(y), (26) gives 


L(uv) = L(E(x) : E(y)) = L(E(x + y)) =x + y, 
so that 
(40) L(uv) = L(u) + L(v) (u> 0; 0 > 0); 
This shows that L has the familiar property which makes logarithms useful 
tools for computation. The customary notation for L(x) is of course log x. 
As to the behavior of log x as x + +00 and as x >0, Theorem 8.6(e) 


shows that 
log x ~ +00 aS x > +00, 


log x ~ —00 as x +0. 
It is easily seen that 
(41) x" = BOLO 


if x > 0 and 7 is an integer. Similarly, if m is a positive integer, we have 
I 

(42) xim@e2eE (- L(x) 
m 


since each term of (42), when raised to the th power, yields the corresponding 
term of (37). Combining (41) and (42), we obtain 


(43) x? = E(xL(x)) = e2!8* 


for any rational a. 

We now define x*, for any real x and any x > 0, by (43). The continuity 
and monotonicity of E and L show that this definition leads to the same result 
as the previously suggested one. The facts stated in Exercise 6 of Chap. I, are 
trivial consequences of (43). 

If we differentiate (43), we obtain, by Theorem 5.5, 


(44) (x*)’ = E(aL(x)) - = ext}, 


Note that we have previously used (44) only for integral values of x, in which 
case (44) follows easily from Theorem 5.3(b). To prove (44) directly from the 
definition of the derivative, if x* is defined by (33) and ~ Is irrational, is quite 
troublesome. 

The well-known integration formula for x” follows from (44) if x # —1, 


and from (38) if « = —1. We wish to demonstrate one more property of log x, 
namely, 
(45) lim x *logx =0 


x7+m 
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for every « > 0. That is, log x > +00 “slower” than any positive power of x, 
as X > +00. 
For if 0 < ¢<a, and x >I, then 


x x 
‘ne Sa] rtdr<xt{ pe! ae 
1 1 


CoS x” 
: < 
é E 


and (45) follows. We could also have used Theorem 8.6(/) to derive (45). 


THE TRIGONOMETRIC FUNCTIONS 


Let us define 
(46) On) = ; [E(ix) + E(—ix)], SEXy= 5 [E(ix) — E(—ix)]. 


We shall show that C(x) and S(x) coincide with the functions cos x and sin x, 
whose definition is usually based on geometric considerations. By (25), E(Z) = 


E(z). Hence (46) shows that C(x) and S(x) are real for real x. Also, 
(47) E(ix) = C(x) + iS). 


Thus C(x) and S(x) are the real and imaginary parts, respectively, of E(ix), if 
x is teal. By (27), 


| E(ix)|? = E(ix)E(ix) = Elix)E(—ix) = 1, 


so that 
(48) \Gx)| = 1 (x real). 

From (46) we can read off that C(O) = 1, S(0) = 0, and (28) shows that 
(49) C'(x) = — S(x), SiG) = C@&). 


We assert that there exist positive numbers x such that C(x) =0. For 
suppose this is not so. Since C(0) = 1, it then follows that C(x) > 0 for all 
x > 0, hence S’(x) > 0, by (49), hence S is strictly increasing; and since S(O) = 0, 
we have S(x) > 0 if x > 0. Hence if 0 < x < y, we have 


(50) sey - 2) < | ” S(t) dt = C(x) — C(y) <2. 


The last inequality follows from (48) and (47). Since S(x) > 0, (50) cannot be 
true for large y, and we have a contradiction. 


SOME SPECIAL FUNCTIONS 183 


Let x» be the smallest positive number such that C(x.) = 0. This exists, 
since the set of zeros of a continuous function is closed, and C(0) #0. We 
define the number zx by 


1) nm = 2x... 


Then C(z/2) = 0, and (48) shows that S(z/2) = +1. Since C(x) > 0 in 
(0, 7/2), S is increasing in (0, 2/2); hence S(x/2) = 1. Thus 


2) 
i ile 


and the addition formula gives 


(52) Eta = =", baw = 1: 
hence 
(53) Ele + Zi) = Ea) (z complex). 


8.7 Theorem 


(a) The function E is periodic, with period 2ni. 

(6) The functions C and § are periodic, with period 27. 

(c). I/O = ¢ < 2x, fen EG) = 1. 

(da) If zis a complex number with |z| =1, there is a unique t in [0, 27) 
such that E(it) = z. 


Proof By (53), (a) holds; and (4) follows from (a) and (46). 
Suppose 0 < t < n/2 and E(it) = x + iy, with x, yreal. Our preceding 
work shows that0< x<1,0<y<1. Note that 


E(4it) = (x + iy)* = x* — 6x7 y? + y* + 4ixy(x? — y’). 


If E(4it) is real, it follows that x? — y? =0; since x? + »? = 1, by (48), 
we have x? = y? = 4, hence E(4it) = —1. This proves (c). 
IPO <4; << 27, then 


Bit pea | ' = BGty— in #41, 


by (c). This establishes the uniqueness assertion in (d). 

To prove the existence assertion in (d), fix z so that |z| = 1. Write 
z=x+ iy, with x and y real. Suppose first that x >0 and y>0. On 
(0, 2/2], C decreases from | to 0. Hence C(t) = x for some fe [0, 7/2). 
Since C? + S? = 1 and S>0 on (0, 2/2], it follows that z = E(it). 

If x <0 and y > 0, the preceding conditions are satisfied by —iz. 
Hence —iz = E(it) for some te [0, 2/2], and since = E(ni/2), we obtain 
z = E(i(t+ 7/2)). Finally, if y <0, the preceding two cases show that 
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—z= E(it) for some te (0, 2). Hence z= — E(it) = E(i(t + 7)). 
This proves (d), and hence the theorem. 


It follows from (d) and (48) that the curve y defined by 
(54) y(t) = E(it) (0<¢t<2n) 


is a simple closed curve whose range is the unit circle in the plane. Since 
y(t) =iE(it), the length of y is 


2n 
[, vO dt = 2x, 


by Theorem 6.27. This is of course the expected result for the circumference of 
a circle of radius 1. It shows that =, defined by (51), has the usual geometric 
significance. 

In the same way we see that the point y(r) describes a circular arc of length 
fo as ¢ increases from 0 to fg. Consideration of the triangle whose vertices are 
z, = 0, 2. = (to), Zz; = C(t) 
shows that C(t) and S(t) are indeed identical with cos r and sin ¢, if the latter 

are defined in the usual way as ratios of the sides of a right triangle. 

It should be stressed that we derived the basic properties of the trigono- 
metric functions from (46) and (25), without any appeal to the geometric notion 
of angle. There are other nongeometric approaches to these functions. The 
papers by W. F. Eberlein (Amer. Math. Monthly, vol. 74, 1967, pp. 1223-1225) 
and by G. B. Robison (Math. Mag., vol. 41, 1968, pp. 66-70) deal with these 
topics. 


THE ALGEBRAIC COMPLETENESS OF THE COMPLEX FIELD 


We are now in a position to give a simple proof of the fact that the complex 
field is algebraically complete, that is to say, that every nonconstant polynomial 
with complex coefficients has a complex root. 


8.8 Theorem Suppose ay, ..., a, are complex numbers, n> 1, a, #9, 
P(2)=> a2. 
0 

Then P(z) = 0 for some complex number z. 

Proof Without loss of generality, assume a, = 1. Put 
(55) p = inf | P(z)| (z complex) 

If |z| = R, then 
(56) [RGD fe AL =e [ay PRO = [tag 
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The right side of (56) tends to co as R- oo. Hence there exists Ry such 
that |P(z)| > if |z| > Ro. Since |P| is continuous on the closed disc 
with center at 0 and radius Ry, Theorem 4.16 shows that | P(z,)| =u for 
some Zo. 

We claim that p = 0. 

If not, put Q(z) = P(z + z,)/P(Zo). Then Q is a nonconstant poly- 
nomial, Q(0) = 1, and | Q(z)| > 1 for all z. There is a smallest integer k, 
1 < k <n, such that 


(57) Ce) =1452 + -- +t 6.20. 
By Theorem 8.7(d) there is a real 0 such that 
(58) eh, = —|d,|. 


If r > 0 and r*|b,| < 1, (58) implies 
[1+ b, rXe*?| = 1 —r*|b,|, 
so that 
| Q(re'®) | = r*{ 1b, | —rlOxss|— aia ye ili. 


For sufficiently small r, the expression in braces is positive; hence 
| O(re'*)| < 1, a contradiction. 
Phas jo= Othat iss P(z5) = ©. 


Exercise 27 contains a more general result. 


FOURIER SERIES 


8.9 Definition <A trigonometric polynomial is a finite sum of the form 
N 

(59) SCDi="Goet } {ageos nx +ebysininx) _{e»real), 
n=1 


where dy, ..., @y, 6,,..., by are complex numbers. On account of the identities 
(46), (S9) can also be written in the form 


(60) Sor= y Ow eal (x real), 
=n 


which is more convenient for most purposes. It is clear that every trigonometric 
polynomial is periodic, with period 27. 

If n is a nonzero integer, e'”* is the derivative of e'"*/in, which also has 
period 2x. Hence 


if.» (| (e—®, 
(ab) at ax = {4 (ifn = +1, +2,...). 
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Let us multiply (60) by e~'"*, where m is an integer; if we integrate the 
product, (61) shows that 


(62) Cat = [_s(nenim dx 


for |m| < N. If |m| > N, the integral in (62) is 0. 

The following observation can be read off from (60) and (62): The 
trigonometric polynomial f, given by (60), is real if and only if c_, = c, for 
o=8,....@% 

In agreement with (60), we define a trigonometric series to be a series of 
the form 


(63) 2 ey (x real); 


the Mth partial sum of (63) is defined to be the right side of (60). 

If fis an integrable function on [—7z, x], the numbers c,, defined by (62) 
for all integers » are called the Fourier coefficients of f, and the series (63) formed 
with these coefficients is called the Fourier series of f. 

The natural question which now arises is whether the Fourier series of f 
converges to f. or. more generally, whether fis determined by its Fourier series. 
That is to say, if we know the Fourier coefficients of a function, can we find 
the function, and if so, how? 

The study of such series, and. in particular, the problem of representing a 
given function by a trigonometric series, originated in physical problems such 
as the theory of oscillations and the theory of heat conduction (Fourier’s 
“Théorie analytique de la chaleur” was published in 1822). The many difficult 
and delicate problems which arose during this study caused a thorough revision 
and reformulation of the whole theory of functions of a real variable. Among 
many prominent names, those of Riemann, Cantor, and Lebesgue are intimately 
connected with this field, which nowadays, with all its generalizations and rami- 
fications, may well be said to occupy a central position in the whole of analysis. 

We shall be content to derive some basic theorems which are easily 
accessible by the methods developed in the preceding chapters. For more 
thorough investigations, the Lebesgue integral is a natural and indispensable 
tool. 

We shall first study more general systems of functions which share a 
property analogous to (61). 


8.10 Definition Let {¢,} (1 = 1, 2, 3, ...) be a sequence of complex functions 
on [a, 5}, such that 


(64) [ $)bn() dx =0 (nr #m). 
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Then {¢@,,} is said to be an orthogonal system of functions on [a, b]. If, in addition, 


5 
(65) { lone)? dx = 1 


for all n, {,} is said to be orthonormal. 
For example, the functions (27)~4e'"* form an orthonormal system on 
{[—x, x]. So do the real functions 


l cos x sinx cos2x sin 2x 

——— 9 = 9 —"s = “aac 
? / 3 
[on pt Jn yore /n 


If {f,} is orthonormal on [a, b] and if 


._— 
(66) com | SOM Dide (P= 1) 253,...), 
we call c, the nth Fourier coefficient of f relative to {¢,}. We write 
(67) S00) ~ Yn Pal) 


1 


and call this series the Fourier series of f (relative to {¢,,}). 

Note that the symbol ~ used in (67) implies nothing about the conver- 
gence of the series; it merely says that the coefficients are given by (66). 

The following theorems show that the partial sums of the Fourier series 
of f have a certain minimum property. We shall assume here and in the rest of 
this chapter that fe #, although this hypothesis can be weakened. 


8.11 Theorem Ler {¢,} be orthonormal on [a,b]. Let 


(68) Sp(X) - y Cm P(X) 

m=t1 
be the nth partial sum of the Fourier series of f, and suppose 
(69) 1,(X) = i Ym P(X). 

m= 1 
Then 

b b 

(70) [ fas axes [ fa)? ax, 


and equality holds if and only if 
(71) Ya, (mm t,... Mm). 


That is to say, among all functions /,, 5, gives the best possible mean 
Square approximation to f. 
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Proof Let ) denote the integral over [a, b], & the sum from 1 to”. Then 
[Fin = [FE Iain = Coen 
by the definition of {c,,}, 
fal? =ftie=[E rede D HO. = E lp? 
since {@,,} is orthonormal, and so 
| tml? =f UA? = [fin - [ite + fend? 
= | A= 5 Gis ow 
=f 1? - Sled? +E [tm — ends 


which is evidently minimized if and only if y,, = Cn- 
Putting y,, = ¢,, in this calculation, we obtain 


b n b 
(72) [ IsiGol? dx = Y Leal? sf Lf09/? dx, 


a 1 
since J|f—1,|7 = 0. 


8.12 Theorem // {¢,} is orthonormal on [a, 6]. and if 


I(x) apf 2 on $,(X), 
then 
or b : 
(73) Y lel? sf fool? dv. 
n=1 a 
In particular, 
(74) lim c, = 0. 


Proof Letting 1-00 in (72), we obtain (73), the so-called ‘Bessel 
inequality.” 


8.13 Trigonometric series From now on we shall deal only with the trigono- 
metric system. We shall consider functions / that have period 2z and that are 
Riemann-integrable on [—z, 2] (and hence on every bounded interval). The 
Fourier series of fis then the series (63) whose coefficients c, are given by the 
integrals (62), and 


N 
(75) Sy(x) = Sy(f. x) = 2 one 
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is the Mth partial sum of the Fourier series of f. The inequality (72) now takes 
the form 


(76) =| | s (|? dx = ¥ lol? <> ff | f(x)|? dx 
ai... se 2 ee , 


In order to obtain an expression for sy that is more manageable than (75) 
we introduce the Dirichlet kernel 


. . sin (N + 4)x 
77 D ~~ en Ale al 
my no) ally sin (x/2) 


The first of these equalities is the definition of D,(x). The second follows if 
both sides of the identity 
(e"* - 1) Dy(x) — eiiN + 1)x rs e~ tnx 
are multiplied by e ‘*/?, 
By (62) and (75), we have 


I . 
Sif ix) = ‘. i, [ S(t)e ™' dt e’™ 


ly a iano 85 
=x] fo Ing dt, 
so that 
ie , 
(78). sg: X= — | S(t\)Dix — 1) dt = —| f(x — t)Dyl(t) dt. 
2n —n 2n mats 4 
The periodicity of all functions involved shows that it is immateria! over which 
Interval we integrate, as long as its length is 2x. This shows that the two integrals 
in (78) are equal. 
We shall prove just one theorem about the pointwise convergence of 


Fourier series. 


8.14 Theorem /f, for some x, there are constants 6 >0 and M < x such that 


(79) If(x+)-f&X)|< Mtl 
for all te (—64, 4), then 
(80) lim Sy(f; x) = f(x). 


Proof Define 


(81) LO = 1) — f(x) 
g(t) = sin (t/2) 
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for 0 < |r| < 2, and put g(0) = 0. By the definition (77), 


I 54 
= = Dw») dx = I. 
Hence (78) shows that 


Sf. x)—f(x) = = {a sin (w + 5)! dt 


We t 
_ ey ac (1) cos | sin Nt dt + * he ja) sin ; cos Nr dt. 


By (79) and (81), g(t) cos (t/2) and g(t) sin (t/2) are bounded. The last 
two integrals thus tend to 0 as N > o, by (74). This proves (80). 


Corollary /f f(x) =0 for all x in some segment J, then lims,(f: x) =0 for 
every x EJ. 


Here is another formulation of this corollary: 
If f(t) = g(t) for all t in some neighborhood of x, then 
5\(f 3 x) — 5g: x) = 5) f —9; x) 70 as Noo. 


This is usually called the /ocalization theorem. It shows that the behavior 
of the sequence {s,(f; x)}, as far as convergence is concerned, depends only on 
the values of f in some (arbitrarily small) neighborhood of x. Two Fourier 
series may thus have the same behavior in one interval, but may behave in 
entirely different ways in some other interval. We have here a very striking 
contrast between Fourier series and power series (Theorem 8.5). 

We conclude with two other approximation theorems. 


8.15 Theorem /f f is continuous (with period 2n) and if ¢> 0, then there is a 
trigonometric polynomial P such that 


|P(x) -f(~)|<e 


for all real x. 


Proof If we identify x and x + 27, we may regard the 27-periodic func- 
tions on R' as functions on the unit circle 7, by means of the mapping 
x e'*. The trigonometric polynomials, i.e.. the functions of the form 
(60), form a self-adjoint algebra . which separates points on 7, and 
which vanishes at no point of 7. Since T is compact, Theorem 7.33 tells 
us that o 1s dense in (7). This is exactly what the theorem asserts. 


A more precise form of this theorem appears in Exercise 15. 
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8.16 Parseval’s theorem Suppose f and g are Riemann-integrable functions 
with period 2n, and 


(82) T(x) ‘Da ‘. Ch e*. g(x) aa »» Yn = 
Then 
| nt 
(83) lim — [ | f(x) — Sx(f: x)|? dx =0, 
N=? a 2n - = h5 
84 K [" ploygte dx = e3 
( ) 5 p. XG) ax = 2 Cn Pas 
Lge” — —_ oe. 
(85) 5 | _  Mliaaa > enf™ 


Proof Let us use the notation 
l n 1/2 
(86) Wal = {=f 1G? deh 
Bi.” 3% 


Let ¢ > 0 be given. Since fe # and f(z) = f(—7), the construction 
described in Exercise 12 of Chap. 6 yields a continuous 27-periodic func- 
tion /# with 


(87) If-— nl, <e. 


By Theorem 8.15, there is a trigonometric polynomial P such that 
\i(x) — P(x)| <e for all x. Hence jh — Pll,<«. If P has degree No, 
Theorem 8.11 shows that 


(88) |A — sx(A)llz < lh — Pll, <e 
for all N>N,. By (72), with 4 — fin place of f, 
(89) Sx) — Sn(P ile = Ise — Alla S WA — fila < e. 


Now the triangle inequality (Exercise 11, Chap. 6), combined with 
(87), (88), and (89), shows that 


(90) Fane <3e We No): 
This proves (83). Next, 


! nN ‘ N ] n 
(91) x) sr dx =) ¢, i 


= It 


— N 
ome) dk] > &h, 
—N 
and the Schwarz inequality shows that 


(92) <fir-siplol<[f1s-sul? flor} 


[rf - [ssna 
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which tends to 0, as N > o0, by (83). Comparison of (91) and (92) gives 
(84). Finally, (85) is the special case g = f of (84). 


A more general version of Theorem 8.16 appears in Chap. 11. 


THE GAMMA FUNCTION 


This function is closely related to factorials and crops up in many unexpected 
places in analysis. Its origin, history, and development are very well described 
in an interesting article by P. J. Davis (Amer. Math. Monthly, vol. 66, 1959, 
pp. 849-869). Artin’s book (cited in the Bibliography) is another good elemen- 
tary introduction. 

Our presentation will be very condensed, with only a few comments after 
each theorem. This section may thus be regarded as a large exercise, and as an 
opportunity to apply some of the material that has been presented so far. 


8.17 Definition For 0 < x < o, 
(93) T(x) = { 167! dt. 
0 
The integral converges for these x. (When x < 1, both 0 and o have to 
be looked at.) 


8.18 Theorem 
(a) The functional equation 


V(x + Tl) =oxIT®) 


holds if0 < x < o. 
(> i@i 1) =a! ero 1, 268, .... 
(c) log T is convex on (0, o). 


Proof An integration by parts proves (a). Since I'(1) = 1, (a) implies 


(6), by induction. If 1<p< o and (1/p) + (1/q) = 1, apply Hélder’s 
inequality (Exercise 10, Chap. 6) to (93), and obtain 


r(% ne ”) < T(x)!" (y)"4. 
P q 
This is equivalent to (c). 


It is a rather surprising fact discovered by Bohr and Mollerup, that 
these three properties characterize I’ completely. 
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8.19 Theorem /// is a positive function on (0, 2) such that 
Gy er Tyee &). 
(6) f()=1, 
(c) log fis convex, 

then f(x) = T(x). 


Proof Since T satisfies (a), (b), and (c), it is enough to prove that f(x) is 
uniquely determined by (a), (4), (c), for all x > 0. By (a). it is enough to 
do this for x € (0, 1). 
Put g = log f. Then 
(94) p(x + 1) = p(x) + log x COM er), 


(1) = 0, and ¢ is convex. Suppose 0 < x < I, and vis a positive integer. 
By (94). v(n + 1) = log(n!). Consider the difference quotients of ~ on the 
intervals [a.m + 1), (7 + loa + 14+ x). [2 + 1.2 + 2). Since ~ is convex 


+1+x)- + | 
og e Geet | hal + < log (n+ 1%: 
: oS 


Repeated application of (94) gives 
p(n + 1+ x) = px) + log [x(x + 1) +++ (v + #)). 


Thus 


a = n'in* ule (: : 
7) i = eta - xX a ee. . 
. “te aw. n 


The last expression tends to 0 as n + x. Hence (x) is determined. and 
the proof is complete. 
As a by-product we obtain the relation 


95 —— nin* 

§ > in 

O°) - nr) err as 

at least when 0 < x < 1; from this one can deduce that (95) holds for all x > 0, 
sincesl (OS 1) = xP (x). 


8.20 Theorem /f x >O and y > 0, then 


: Pe@eleci4 
Soe | = pel = Sie 3, ee 
(96) I, ai ty eet 


This integral is the so-called beta function B(x, )'). 
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Proof Note that B(1, y) = 1/y, that log B(x, y) is a convex function of 
x, for each fixed y, by H6lder’s inequality, as in Theorem 8.18, and that 


x 
(97) Bx + 1,.y) = —— Beg): 
x+y 
To prove (97), perform an integration by parts on 
B(x +1, y) [ ( : ya rem! at 
rel, y= —— ~ 
y o \l-—t 


These three properties of B(x, y) show, for each y, that Theorem 8.19 
applies to the function / defined by 
T(x + y) 


I(x) = ” eae D(x, y). 


Fience (x)= Fi). 


8.21 Some consequences The substitution ¢ = sin? 0 turns (96) into 


Oe ; . T(x)T() 
98 2 | 6)?9-! dd = —__—_.. 
(98) I, (sin 6) (cos 8) Fa 5) 
The special case x = y = 4 gives 
(99) rd) = Jn. 
The substitution ¢ = s? turns (93) into 
(100) iW 2 { s*-le-* ds (O<x< 0). 
0 
The special case x = 4 gives 
(101) | eit ds = \/n. 
By (99), the identity 
aaa ] 
(102) ee r(s)r(* wu 
fa OP 2 


follows directly from Theorem 8.19. 


8.22 Stirling’s formula This provides a simple approximate expression for 
I(x + 1) when x is large (hence for n! when n is large). The formula is 


(103) Fees ae wee 
xa (x/e)* of 20x 
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Here is a proof. Put ¢ = x(1 + uv) in (93). This gives 
(104) T(x + 1) = 2x7"! a | [((l + we-"}* du. 
— | 
Determine /(u) so that A(0) = 1 and 
ur 
(105) (1 + me” =.exp | — Ac] 
if —1<u<o,u#0. Then 
2 
(106) h(u) = a [u — log (1 + w)}. 
It follows that / is continuous, and that A(u) decreases monotonically from oo 


to 0 as uw increases from —1 to oo. 
The substitution u=s /2/x turns (104) into 


(107) P(x + 1) = xe * /2x bMeyds 
where 
wor (valestlfoas (—./2/2 < s < &), 
a," (s < —,/x/2). 


Note the following facts about w,(s): 


(a) For every s, y,(s) ~e~* as x + 00. 

(6) The convergence in (a) is uniform on [— 4, A], for every A < oo. 
(c) When s <0, then 0 < y,(s) <e™*. 

(d) When s>0Oand x > 1, then 0 < ),(s) < ,(s). 

(e) J§ Wy(s) ds < o. 


The convergence theorem stated in Exercise 12 of Chap. 7 can therefore 


be applied to the integral (107), and shows that this integral converges to \/n 
as x + 00, by (101). This proves (103). 

A more detailed version of this proof may be found in R. C. Buck’s 
“Advanced Calculus,” pp. 216-218. For two other, entirely different, proofs, 
see W. Feller’s article in Amer. Math. Monthly, vol. 74, 1967, pp. 1223-1225 
(with a correction in vol. 75, 1968, p. 518) and pp. 20-24 of Artin’s book. 

Exercise 20 gives a simpler proof of a less precise result. 


196 PRINCIPLES OF MATHEMATICAL ANALYSIS 


EXERCISES 
1. Define 


re Cee 


SOF " (x = 0). 


Prove that f has derivatives of all orders at x =0, and that f‘(0)=0 for 
R= Lessa. 


2. Let a., be the number in the ‘th row and /th column of the array 


—1 0 0 0 
4; —] 0 0 
t : —3 0 
t 4 + —I1 
so that 
0 (<p; 
aiy=\—1 (i=J), 
ae Gy 
Prove that 


3. Prove that 


if a,, >0 for all i and j (the case + 00 = + 00 may occur). 
4. Prove the following limit relations: 


(a) lim a al log 6 = =(6>0). 
x70 x 


(b) lim log 1 + x) _ ,. 
x—0 x 


(e) lum¢b-++xv)™ =e: 
x0 


(d) lim ( + *) _aygel 
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5. Find the following limits 
= 1/x 
(a) lim a 
x20 x 
: n 1/n __ 
@ _ log n [n me 
(c) lim fan x — x 
o oa x(1 — cos x)’ 
(d) lim 2—Si0 x 
x~o tan x — x 
6. Suppose f(x) f(y) = f(x + y) for all real x and y. 
(a) Assuming that fis differentiable and not zero, prove that 
f(x) = e* 
where c is a constant. 
(b) Prove the same thing, assuming only that fis continuous. 
72 If Ome x < = prove that 
2 sin x } 
x 
8. For n= 0,1, 2,..., and x real, prove that 


10. 


|sin nx| <n|sin x}. 
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Note that this inequality may be false for other values of #. For instance, 


|sin 4] > $|sin 7. 


. (a) Put sy = 1-+(4)+---+(1/N). Prove that 


lim (sy — log N) 
N- 0 


exists. (The limit, often denoted by y, is called Euler’s constant. Its numerical 


value is 0.5772.... It is not known whether y is rational or not.) 
(b) Roughly how large must m be so that N = 10” satisfies sy > 100? 
Prove that >" 1/p diverges; the sum extends over all primes. 


(This shows that the primes form a fairly substantial subset of the positive 


integers.) 
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Hint: Given N, let pi,..., px be those primes that divide at least one in- 
teger <N. Then 


> + < Bt Se bg 
natu 8 jea P; pi 
k nn 
= foes 
I >) 
i 2 
<exp)> —. 
J=1 Pj 


The last inequality holds because 
(1 wees i <e=* 


ifO<x<}h. 
(There are many proofs of this result. See, for instance, the article by 
I. Niven in Amer. Math. Monthly, vol. 78, 1971, pp. 272-273, and the one by 
R. Bellman in Amer. Math. Monthly, vol. 50, 1943, pp. 318-319.) 
11. Suppose fe # on [0, A] for all A < 2, and f(x) > 1 as x > + 2. Prove that 


lim r| e~f(xydx=1  (t > 0). 

1-0 Jo 

12. Suppose'0.< 6 < 7, f(x) = 1 if jw) <5, fw) —O1f 3. < |x| <rpand ft 2a) — 
JS (x) for all x. 
(a) Compute the Fourier coefficients of / 
(b) Conclude that 


—_= = Wee ducer 


(c) Deduce from Parseval’s theorem that 


sin = _ a ) 


— 


(d) Let 5 ~0 and prove that 


(e) Put 6 = 7/2 in (c). What do you get? 
13. Put f(x) = x if 0< x < 27, and apply Parseval’s theorem to conclude that 


qr? 


o | 
La 
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14. If f(x) = (7 — |x|)? on [ —7, 7], prove that 


co 


one 4 
fty= 7 + s 72 COS nx 


and deduce that 
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(A recent article by E. L. Stark contains many references to series of the form 
> n-*, where s is a positive integer. See Math. Mag., vol. 47, 1974, pp. 197-202.) 


15. With D, as defined in (77), put 


N 
Ky(x) = = ELE, Dex). 
Prove that 
_. |! T-sa@ + ie 
cum | 1—cosx 
and that 
(a) Ky >0, 


(b) 5 f Kalx) de = 1, 
ZT 2 


a 


— 20 <7. 
= Neat 1— como P Ogi [alles 


If sy = Sn(f; x) is the Nth partial sum of the Fourier series of f, consider 


the arithmetic means 


Soa a tS 
N+1 


On = 
Prove that 
1 4 
on fs 2) = 5 { f(x — OK aAt) dt, 
TJ =x 


and hence prove Fejér’s theorem: 


If f is continuous, with period 27, then on(f; x) > f(x) uniformly on (= 7, 7). 


Hint: Use properties (a), (b), (c) to proceed as in Theorem 7.26. 


16. Prove a pointwise version of Fejér’s theorem: 
If fe BR and f(x +), f(x —) exist for some x, then 


Jim on(f; Xy— ALL + t+ fe). 
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i: 


18. 


19. 


20. 


Assume / is bounded and monotonic on [—7, 77), with Fourier coefficients c,, as 
given by (62). 

(a) Use Exercise 17 of Chap. 6 to prove that {7c,} is a bounded sequence. 

(6) Combine (a) with Exercise 16 and with Exercise 14(e) of Chap. 3, to conclude 
that 


lim sx fx) =e Ge) -S@—)] 


for every x. 
(c) Assume only that fe @ on [—7, 7] and that f is monotonic in some segment 
(a, B)< [—7, 7]. Prove that the conclusion of (6) holds for every x € (a, B). 
(This is an application of the localization theorem.) 
Define 


f@)= x* — sin? ten *X 
g(x) = 2x? — sin? x — x tan x. 
Find out, for each of these two functions, whether it is positive or negative for all 


x € (0, 7/2), or whether it changes sign. Prove your answer. 


Suppose / is a continuous function on R', f(x + 27) = f(x), and «/7 is irrational. 
Prove that 


lim +S flxtnay= [finde 
Proc N n= = - On =n ) 


1 


for every x. Hint: Do it first for f(x) = e'**. 


The following simple computation yields a good approximation to Stirling’s 
formula. 


For m= 1, 2, 3, ..., define 


f(x) = (m+ 1 — x) log m+ (x — m) log (m+ 1) 
if m<x<m-+1, and define 


oie —1+1logm 
mm 


ifm—4<x<m-+}. Draw the graphs of fand g. Note that f(x) < log x < g(x) 
if x > 1 and that 


ft I(x) dx = log (n!) — }logn> —44+ [ gixyrdx. 


Integrate log x over [1, 7]. Conclude that 
& <log(n!)— (n+ 4) logntn<l 
for n = 2, 3,4,.... (Note: log V27 ~ 0.918... .) Thus 


nt 
7/8 es 
e QS EE, 
(nl/e)"V n 


a. 


p B 


23: 


24. 
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Let 
1 ba 
L,= > | Koni: was. 
CH... 


Prove that there exists a constant C > 0 such that 
L, > C leg n (mm 1, 2,3, ...), 


or, more precisely, that the sequence 
4 
2 a logn 


is bounded. 
If « is real and --1 <x < 1, prove Newton’s binomial theorem 
(ie 1 


n=1 n! 


Hint; Denote the right side by f(x). Prove that the series converges. Prove that 
(L -- x) f(x) = af (x) 


and solve this differential equation. 
Show also that 


if -—Il<x<landa>0O. 
Let y be a continuously differentiable closed curve in the complex plane, with 
parameter interval [a, b], and assume that y(t) + 0 for every ¢ € [a, b]. Define the 
index of y to be 
len yi 

y(t) } 


ing a= 7 


Prove that Ind (y) is always an integer. 

Hint; There exists m on [a, b] with @’ = yy, p(a) = 0. Hence yexp( 9) 
is constant. Since y(a) = y(b) it follows that exp g(h) = exp p(a) = I. Note that 
g(b) == 277i Ind (y).: 

Compute Ind (vy) when y(t) = e'", a = 0, b= 2m. 

Explain why Ind (y) is often called the winding number of y around 0. 

Let y be as in Exercise 23, and assume in addition that the range of y does not 
intersect the negative real axis. Prove that Ind(y) <0. Mit: For O-.c-) «, 
Ind (y +c) is a continuous integer-valued function of c. Also, Ind(y 1 ¢) +9 
asc, 
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25. 


26. 


27. 


28. 


Suppose y, and y,2 are curves as in Exercise 23, and 
lyi(t) — y2(t)| < |yi(t)| (a<t<b). 
Prove that Ind (y,) = Ind (y2). 
Hint: Put y = y2/y1. Then |! — y| <1, hence Ind (y) = 0, by Exercise 24. 
Also, 


—_—_— 


Let y be a closed curve in the complex plane (not necessarily differentiable) with 
parameter interval [0, 277], such that y(t) #0 for every ¢ e [0, 27]. 

Choose 6 > 0 so that |y(t)| > 6 for all ¢ € (0, 27). If P, and P, are trigo- 
nometric polynomials such that | P(t) -- y(t)| < 6/4 for all ¢ € [0, 27] (their exis- 
tence is assured by Theorem 8.15), prove that 

Ind (P,) = Ind (P:2) 
by applying Exercise 25. 

Define this common value to be Ind (y). 

Prove that the statements of Exercises 24 and 25 hold without any differenti- 
ability assumption. 

Let f be a continuous complex function defined in the complex plane. Suppose 
there is a positive integer 7» and a complex number c + 0 such that 


lim z~-"f(z)= . 


[z]~ a 

Prove that f(z) = 0 for at least one complex number z. 

Note that this is a generalization of Theorem 8.8. 

Hint: Assume f(z) 40 for all z, define 

y(t) = f(re") 

for 0O<r<o,0<1t< 2m, and prove the following statements about the curves 
Vr: 
(a) Ind (yo) = 0. 
(b) Ind (y,) =n» for all sufficiently large r. 
(c) Ind (y,) is a continuous function of r, on [0, x). 
{In (6) and (c), use the last part of Exercise 26.] 

Show that (a), (5), and (c) are contradictory, since n > 0. 
Let D be the closed unit disc in the complex plane. (Thus z € D if and only if 
|z| <1.) Let g be a continuous mapping of D into the unit circle 7. (Thus, 
|g(z)| = 1 for every ze D.) 

Prove that g(z) = —z for at least one z € T. 

Hint: ForO0<r<1,0<t<2z, put 

y(t) = g(re"), 

and put P(r) = e-"y, (1). If g(z) # —z for every z € T, then y(t) 4 —1 for every 
t € [0, 277]. Hence Ind (5) = 0, by Exercises 24 and 26. It follows that Ind (y,) =1. 
But Ind (yo) = 0. Derive a contradiction, as in Exercise 27. 
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29. Prove that every continuous mapping fof D into D has a fixed point in D. 

(This is the 2-dimensional case of Brouwer’s fixed-point theorem.) 

Hint: Assume f(z) ¢ z for every z€ D. Associate to each ze D the point 
g(z) € T which lies on the ray that starts at f(z) and passes through z. Then g 
maps D into 7, g(z) = z if z € T, and g is continuous, because 

Gz) —2,—s(2) Xz) —2); 

where s(z) is the unique nonnegative root of a certain quadratic equation whose 
coefficients are continuous functions of fand z. Apply Exercise 28. 
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FUNCTIONS OF SEVERAL VARIABLES 


LINEAR TRANSFORMATIONS 


We begin this chapter with a discussion of sets of vectors in euclidean n-space R". 
The algebraic facts presented here extend without change to finite-dimensional 
vector spaces over any field of scalars. However, for our purposes it is quite 
sufficient to stay within the familiar framework provided by the euclidean spaces. 


9.1 Definitions 


(a) A nonempty set X c R" is a vector space ifx +yeX and cxe X 
for all x € XY, y € X, and for all scalars c. 


(b) If Xgsuusgexpe R™ and c,,..., & are scalars, the vector 
C\X + °°* + Ome 


is called a linear combination of x,,..., x,. If Sc R" and if E is the set 


of all linear combinations of elements of S, we say that S spans E, or that 
E is the span of S. 


Observe that every span is a vector space. 
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(c) A set consisting of vectors x,,..., x, (we shall use the notation 
{x,,...,X,} for such a set) is said to be independent if the relation 
e) mer he 8, = 6 hnpliesthat c, = ~~ =c, Or Orienwisate,..... , xz} 
is said to be dependent. 

Observe that no independent set contains the null vector. 
(d) Ifa vector space X¥ contains an independent set of r vectors but con- 
tains no independent set of r + 1 vectors, we say that X has dimension r, 
and write: dim X¥ =r. 

The set consisting of 0 alone is a vector space; its dimension is 0. 
(e) An independent subset of a vector space X which spans X is called 
a basis of X. 

Observe that if B = {x,....,x,} is a basis of X, then every xe XY 
has a unique representation of the form x = £c;x,;. Such a representation 
exists since B spans X. and it is unique since B is independent. The 


numbers c,, ..., ¢, are called the coordinates of x with respect to the 
basis B. 
The most familiar example of a basis is the set {e,, ..., e,}, where 


e, is the vector in R” whose jth coordinate is | and whose other coordinates 
are all 0. If xe R". x =(x,...., x,), then x = 2x,e;. We shall call 


fey...ow, € 


the standard basis of R”. 


9.2. Theorem Let r be a positive integer. If a vector space X is spanned by a 
set of r vectors, then dim X <r. 


Proof If this is false. there is a vector space X which contains an inde- 
pendentaerO sm, . ..«. y,+ 1} and which is spanned by a set Sp consisting 
of r vectors. 

Suppose 0 <i <r, and suppose a set-S; has been constructed which 
spans X and which consists of all y; with | </ </ plus a certain collection 
of r — i members of S,. say x;...., X,-;. (In other words. S; 1s obtained 
from Sy by replacing / of its elements by members of Q, without altering 
the span.) Since S; spans X. y;,, is in the span of S;; hence there are 
SCAIBESEA ctu @: cgetPas some Op ag. With a;q weol,.such that 


ict | r-i 


t 
Y ayy, + > ox, = 0. 
i k=1 
If all b,’s were 0, the independence of Q would force all a,'s to be 0, a 
contradiction. It follows that some x, € S; is a linear combination of the 
other members of 7; = S; vu {y;4,}. Remove this x, from 7, and call the 
remaining set S;,,. Then S;,, spans the same set as 7;, namely X, so 
that S;,, has the properties postulated for S; with / + | in place of /. 


206 PRINCIPLES OF MATHEMATICAL ANALYSIS 


Starting with S,. we thus construct sets S,..... S,. The last of 
these consists of y,..... y,. and our construction shows that it spans Y. 
But Q is independent; hence y,,, 1s not in the span of S,. This contra- 
dicticn establishes the theorem. 


Corollary dim R”’ =n. 
Proof Since fe,.....e,} spans R”, the theorem shows that dim R" <n. 
Since {e,, ..., e,} is independent, dim R" > n. 

9.3. Theorem Suppose X is a vector space, and dim X =n. 


(a) A set E of n vectors in X spans X if and only if E is independent. 
(b) X has a basis, and every basis consists of n vectors. 


(c) Ifl<r<nandty,.....y,\ ts an independent set in X. then X has a 
basis containing {y,...., Y,}. 
Pro@f Suppose — = (x... .«. %A Singe dim WF =. the set (K,...... 2%.) 


is dependent. for every ye X. If E is independent. it follows that y is in 
the span of E; hence E spans ¥. Conversely. if E is dependent, one of its 
members can be removed without changing the span of £. Hence E 
cannot span X. by Theorem 9.2. This proves (a). 

Since dim ¥ =n. X contains an independent set of vectors, and 
(a) shows that every such set 1s a basis of XY: (b) now follows from 9.1(d) 
and 9.2. 

To prove (c), let {x;...... Xx,} bea basis of Me” Thesset 


spans X and is dependent. since it contains more than # vectors. The 
argument used in the proof of Theorem 9.2 shows that one of the x,’s is 
a linear combination of the other members of S. If we remove this x; from 
S. the remaining set still spans X. This process can be repeated r times 
and leads to a basis of X which contains {y,, ..., y,}, by (a). 


9.4 Definitions A mapping 4 of a vector space Y into a vector space Y is said 
to be a /inear transformation if 


MS, +X) = Ay + As, Alex) = cAx 


for all x. x,. x, € X and all scalars c. Note that one often writes Ax instead 
of A(x) if A is linear. 

Observe that AO = Oif A is linear. Observe also that a linear transforma- 
tion A of X into Y is completely determined by its action on any basis: If 


FUNCTIONS OF SEVERAL VARIABLES 207 


(Xy,---.X,; 18 a basis of X, then every x € X has a unique representation of the 
form 


and the linearity of A allows us to compute Ax from the vectors Ax,;...., AX, 
and the coordinates c,,..., c, by the formula 


n 
Nee TY G AK. 
i=1 
Linear transformations of X into X are often called /inear operators on X. 
If A is a linear operator on XY which (i) is one-to-one and (ii) maps X onto 
X. we say that A is invertible. In this case we can define an operator 4~' on X 
by requiring that 4~'(Ax) =x for all xe X. It is trivial to verify that we then 
also have A(A~'x) =x, for all x € X, and that A7! is linear. 
An important fact about linear operators on finite-dimensional vector 
spaces is that each of the above conditions (1) and (11) implies the other: 


9.5 Theorem 4 /inear operator A on a finite-dimensional vector space X is 
one-to-one if and only if the range of A is all of X. 
Proof Let {x,,....x,} be a basis of X. The linearity of A shows that 
its. range 3A) is the span of the sét OQ = {Ax,...., A&,}. We therefore 
infer from Theorem 9.3(a) that A(A) = X if and only if Q is independent. 
We have to prove that this happens if and only if A is one-to-one. 
Suppose A is one-to-one and ic; Ax; = 0. Then A(Xc;x;) = 0, hence 


Reaae= 0, Wenceic; = --: =c, =, and"*we concludé"that Q is independent. 
Conversely, suppose Q is independent and A(2c;x;) =90. Then 
Lc; AX; = 0. hence c, =-:* =a, = 0, and,we conclude: 4x =9 only if 


x = 0. If now 4x = Ayothen A(x — y)=— Ax — Ay = 0. so thatx — y = 0, 
and this says that A is one-to-one. 


9.6 Definitions 
(a) Let L(X, Y)betheset of all linear transformations of the vector space 
X into the vector space Y. Instead of L(V. ¥). we shall simply write LOX). 
iA, Asc L(X, Y) andvif'c,. c, arewsealars, define’eyA, +c, A, by 

(cyAy + cotAig xe) Ayx GA e® (xe Y). 

It is then clear that c,A, + c, A, EL(X, Y). 
(b) If ¥. ¥. Z are vector spaces. and if Ae /(N. Y) and Be L(Y, Z), we 
define their product BA to be the composition of 4 and B: 


(BA)x = B(Ax) (xe VX). 
Then BA € L(X, Z). 
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Note that BA need not be the same as AB, even if ¥ = Y = Z. 
(c) For AeL(R’, R™), define the norm ||A|| of A to be the sup of all 
numbers | Ax|. where x ranges over all vectors in R” with |x| < 1. 
Observe that the inequality 


| Ax| < |All |x| 
holds for all xe R". Also, if 4 is such that | Ax| < 4|x| for all x © R’, 
then ||A|| < 2. 
Theorem 


(a) If Ae L(R", R"), then |\|A\| < c and A is a uniformly continuous 
mapping of R" into R™. 
(6) If A, Be L(R’, R™) and c is a scalar, then 


4+ Bi < YA +B, IleAl} = |e] HAt. 


With the distance between A and B defined as \\A — B)|, L(R", R™) is a 
metric space. 
(c) If AE L(R". R") and Be L(R™. R*), then 


|BAj| < | Bll | Al. 
Proof 
(a) Let {e,.....e,} be the standard basis in R" and suppose x = Ic;e,;, 
se. <1, Serta | op) 1) POP) Thee. er 
| Ax| =|) c,Ae;| <>) lei] | Ae: <b | Aeil 
so that 


Since | Ax — Ay| < | A! |x —y| if x, ye R", we see that 4 is uniformly 
continuous. 
(b) The inequality in (6) follows from 
\(A + B)x| = !Ax + Bx| < |Ax| + | Bx! < (All + Bil) |x]. 
The second part of (5) is proved in the same manner. If 
A, B).C CLG a, 


we have the triangle inequality 


[A — Cl =i(A — B) + (B— C)i] s lA — Bi + B= Ci, 
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and it is easily verified that ||A — Bil has the other properties of a metric 
(Definition 2.15). 
(c) Finally, (c) follows from 
|(BA)x| = | B(Ax)| < ||Bl| |Ax| < BI) ll |x. 
Since we now have metrics in the spaces L(R", R™). the concepts of open 


set. continuity, etc.. make sense for these spaces. Our next theorem utilizes 
these concepts. 


9.8 


ny 


(2) 


Theorem Let 2 be the set of all invertible linear operators on R". 
(a) IfAEQ. Be L(R’). and 
ie — All, lr <1, 


then Be Q. 
(b) Q is an open subset of L(R"), and the mapping A — A~' is continuous 
on QQ. 
(This mapping is also obviously a | — 1 mapping of 2 onto Q, 
which is its own inverse.) 


Proof 
(a) Put {A~'|) =1/x. put {|B — All =f. Then B <x. For every xe R", 
gis — ala Amo yy ex | 
= | Ax| < |(A — B)x| + | Bx| < B|x| + | Bx], 
so that 


(x — f)|x| < | Bx| (x € R"). 


Since x — B > 0. (1) shows that Bx #0 if x #0. Hence Bis | — I. 
By Theorem 9.5. BEQ. This holds for all B with ||B-- Al| <x. Thus 
we have (a) and the fact that Q is open. 
(b) Next. replace x by B-'y in (1). The resulting inequality 


(x — p)|B-ly|< |BBly|=ly| (ye R”) 
shows that ||B™ ||! < (a — B)~'. The identity 
ps Pe Poe By. 


combined with Theorem 9.7(c), implies therefore that 


: . r “ B 
JB>? — A" < Bo" 1A — Bi A I< 


This establishes the continuity assertion made in (6), since f + 0 as B- A. 
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9.9 Matrices Suppose {x,,..., x,} and {y,,.... y,,} are bases of vector spaces 
X and Y, respectively. Then every 4 e€ L(X, Y) determines a set of numbers 
a;; such that 


m 


(3) Ati = ) Stay a 
i= 


It is convenient to visualize these numbers in a rectangular array of m rows 
and n columns, called an m by n matrix: 


Qi; 442 a, 

a a a 
= ae on 

Gint Qn2 Ginn 


Observe that the coordinates a,; of the vector Ax, (with respect to the basis 
{y,,.--, Ym}) appear in the jth column of [4]. The vectors Ax, are therefore 
sometimes called the column vectors of [A]. With this terminology. the range 
of A is spanned by the column vectors of [A]. 

If x = Xc,x;. the linearity of A, combined with (3). shows that 


mt Nn a 
(4) Ax =) (5 a5¢)) yi- 
f=1 \j=1 ! 
Thus the coordinates of Ax are L,a;,;c;. Note that in (3) the summation 
ranges over the first subscript of a;;. but that we sum over the second subscript 
when computing coordinates. 

Suppose next that an mm by 7 matrix is given. with real entries a;,. If A ts 
then defined by (4), it is clear that A € L(Y. Y) and that [A] ts the given matrix. 
Thus there is a natural: 1I-1 correspondence between L( XY, ¥) and the set of all 
real m by 1 matrices. We emphasize. though, that [4] depends not only on A 
but also on the choice of bases in XY and ¥. The same A may give rise to many 
different matrices if we change bases, and vice versa. We shall not pursue this 
observation any further. since we shall usually work with fixed bases. (Some 
remarks on this may be found in Sec. 9.37.) 

If Z is a third vector space. with basis {Z,....,2Z,}. if A is given by (3), 
and if 


then AE L(X, Y), BE L(Y. Z), BA € LCX, Z), and since 
B(Ax,;) = By) ay, = » a;; By; 


= a:, ) bya =a (2 Peis) zy, 
k k i 
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the independence of {z,,..., z,} implies that 


(5) Cx; =) by ij; (hc *eep, 1 <j ony 


This shows how to compute the p by n matrix [BA] from [B] and [A]. If we 
define the product [B][A].to be [BA], then (5) describes the usual rule of matrix 
multiplication. 

Finally, suppose {x,,..., x,} and {y,,..., y,,} are standard bases of R" and 
R™, and A is given by (4). The Schwarz inequality shows that 

| Ax|? = > (2 il < y (2 ah: y <i) - » aij|x|?. 
' J U J J 'nJ 
Thus 
(6) Wal < (5 aj)" 
i,j 


If we apply (6) to B— A in place of A, where A. Be L(R", R™), we see 
that if the matrix elements a;; are continuous functions of a parameter, then the 
same is true of A. More precisely: 


If S is a metric space, if A,4, -.., Amnq are real continuous functions on S, 
and if, for each p € S, A, is the linear transformation of R" into R™ whose matrix 
has entries a;p), then the mapping p— A, is a continuous mapping of S into 
IRR’ R®". 


DIFFERENTIATION 


9.10 Preliminaries In order to arrive at a definition of the derivative of a 
function whose domain is R" (or an open subset of R"), let us take another look 
at the familiar case n = 1, and let us see how to interpret the derivative in that 
case in a way which will naturally extend ton > 1. 

If fis a real function with domain (a, b) c R' and if x € (a, b), then f(x) 
is usually defined to be the real number 
(7) oe 


h-+0 h 


provided, of course, that this limit exists. Thus 


(8) L(x +h) — Fx) =f’ Oh + 1A) 
where the “‘remainder”’ r(’) is small, in the sense that 
h 
(9) lim r(”) =(). 
h-0 h 
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Note that (8) expresses the difference f(x + h) — f(x) as the sum of the 
linear function that takes h to f’(x)A, plus a small remainder. 

We can therefore regard the derivative of f at x, not as a real number, 
but as the linear operator on R' that takes h to f'(x)h. 

[Observe that every real number ~ gives rise to a linear operator on R’; 
the operator in question is simply multiplication by «. Conversely, every linear 
function that carries R' to R' is multiplication by some real number. It is this 
natural 1-1 correspondence between R' and L(R') which motivates the pre- 
ceding statements. } 

Let us next consider a function f that maps (a, b) c R' into R™. In that 
case, f(x) was defined to be that vector y € R”™ (if there is one) for which 


(10) iline i LP AEs 


h-»0 h 


= 0. 


We can again rewrite this in the form 
(11) f(x + h) — f(x) =hy + r(A), 


where r(h)/h > 0 as h-0. The main term on the right side of (11) is again a 
linear function of h. Every y € R”™ induces a linear transformation of R! into 
R™, by associating to each Ae R' the vector hy € R”. This identification of R” 
with L(R', R”) allows us to regard f’(x) as a member of L(R', R”). 

Thus, if f is a differentiable mapping of (a, b) c R' into R”, and if x € (a, b), 
shen f’(x) is the linear transformation of R' into R™ that satisfies 


f(x + h) — f(x) —f' (xh 
ee 


12 li 0, 
(12) hae ; 
or, equivalently, 
f h) — f(x) —f'(x)h 
(13) lim [£@e + A) — £0) — P'GOAl 26. 
—h0 [Al 


We are now ready for the case 1 > 1. 
9.11. Definition Suppose £ is an open set in R”, f maps E into R”, and xe E. 
If there exists a linear transformation A of R" into R”™ such that 


(14) a |f(x + h) — f(x) — Ah| 0, 
h-0 | h| 


then we say that f is differentiable at x, and we write 
(15) {'(x) =A. 


If f is differentiable at every x € E, we say that f is differentiable in E. 
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It is of course understood in (14) that he R”. If |h| is small enough, then 
x +he FE, since E is open. Thus f(x +h) is defined, f(x + h)€ R”, and since 
Ae L(R", R"), Ahe R™. Thus 


f(x + h) — f(x) — Ahe R”. 
The norm in the numerator of (14) 1s that of R”. In the denominator we have 
the R’-norm of h. 
There is an obvious uniqueness problem which has to be settled before 
we go any further. 


9.12 Theorem Suppose E and f are as in Definition 9.11, x € E, and (14) holds 
with A = A, and with A = A,. Then A, =A}. 
Proof If B =A, — A,. the inequality 
| Bh| < |f(x +h) — f(x) — A,h| + | f(x + h) — f(x) — 4,h| 
shows that | Bh|/|h| +0 ash-—0. For fixed h ¥ 0, it follows that 
| B(th) 
| th 


The linearity of B shows that the left side of (16) is independent of 1. 
Thus Bh = 0 for every he R". Hence B =0. 


(16) 0 as t—0. 


9.13 Remarks 
(a) The relation (14) can be rewritten in the form 
(17) f(x + h) — f(x) =f'(x)h + r(h) 


where the remainder r(h) satisfies 


_ |r(h)| 
i a 

We may interpret (17), as in Sec. 9.10, by saying that for fixed x and small 
h, the left side of (17) is approximately equal to f‘(x)h, that is, to the value 
of a linear transformation applied to h. 
(b) Suppose f and E are as in Definition 9.11, and f is differentiable in E. 
For every x € E, f(x) is then a function, namely, a linear transformation 
of R" into R™. But f’ is also a function: f’ maps F into L(R", R”). 
(c) A glance at (17) shows that f is continuous at any point at which f TS 
differentiable. 
(d) The derivative defined by (14) or (17) is often called the differential 
of f at x, or the total derivative of f at x, to distinguish it from the partial 
derivatives that will occur later. 
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9.14 Example We have defined derivatives of functions carrying R” to R™ to 
be linear transformations of R” into R”. What is the derivative of such a linear 
transformation? The answer is very simple. 


If A € L(R", R™) and if x € R", then 
(19) A'(x) = A. 


Note that x appears on the left side of (19), but not on the right. Both 
sides of (19) are members of L(R", R™), whereas Ax € R”. 
The proof of (19) is a triviality, since 


(20) A(x +h) — Ax = Ah, 


by the linearity of A. With f(x) = Ax, the numerator in (14) is thus 0 for every 
me R”. In 17)rhh) =. 


We now extend the chain rule (Theorem 5.5) to the present situation. 


9.15 Theorem Suppose E is an open set in R",f maps E into R"™, f is differentiable 
at X, € E, g maps an open set containing f(E) into R*, and g is differentiable at 
f(x,.). Then the mapping ¥ of E into R* defined by 


F(x) = g(f(x)) 
is differentiable at x. , and 
(21) F'(Xo) = & (f(Xo))f (Xo). 


On the right side of (21), we have the product of two linear transforma- 
tions, as defined in Sec. 9.6. 


Proof Put yo =f(Xo), A =f'(Xo), B =g'(yo), and define 
u(h) = f(x, + h) — f(xo) — Ah, 
WK) = 8(¥o + k) — (yo) — Bk, 


for all he R” and k € R™ for which f(x, + h) and g(y, + k) are defined. 
Then 
(22) |u(h)| =e(h)| hl, | v(k)| = n(k)|k|, 
where e(h) > 0 as h-> 0 and n{k) > 0 ask — 0. 
Given h, put k = f(x, + h) — f(x,). Then 


(23) |k| = | Ah + u(h)|< [|| Al] + e(h)) [hl], 
and 
F(x + h) — F(xo) — BAh = g(yo + k) — g(yo) — BAh 
= B(k — Ah) + v(k) 
= Bu(h) + v(k). 
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Hence (22) and (23) imply, for h # 0, that 
| F(x + h) — F(x) — BAh| 
| h| 


Leth—>0. Then c(h)—0. Also, k +90, by (23), so that n(k) > 0. 
It follows that F’(x9) = BA, which is what (21) asserts. 


< || Bll e(h) + [Al] + e(h)In(k). 


9.16 Partial derivatives We again consider a function f that maps an open 
set E < R" into R™. Let {e,,...,e,} and {u,,..., u,,} be the standard bases of 
R" and R". The components of f are the real functions f,, ..., f,, defined by 


(24) f(x) =) ficou, (xe E), 


or, equivalently, by f(x) = f(x): u;, 1 <i<m. 
Forxe £E,1<i<m,1</j <n, we define 


(25) (D, f(x) = lim ————, 
1-0 


provided the limit exists. Writing f,(x,,...,x,) in place of f(x), we see that 
D,f; is the derivative of /; with respect to x;, keeping the other variables fixed. 
The notation 


of, 


26 
(26) 7 


is therefore often used in place of Djf;, and D,f; is called a partial derivative. 

In many cases where the existence of a derivative is sufficient when dealing 
with functions of one variable, continuity or at least boundedness of the partial 
derivatives is needed for functions of several variables. For example, the 
functions f and g described in Exercise 7, Chap. 4, are not continuous, although 
their partial derivatives exist at every point of R?. Even for continuous functions. 
the existence of all partial derivatives does not imply differentiability in the sense 
of Definition 9.11; see Exercises 6 and 14, and Theorem 9.21. 

However, if f is known to be differentiable at a point x, then its partial 
derivatives exist at x, and they determine the linear transformation f’(x) 
completely: 


9.17 Theorem Suppose f maps an open set E < R" into R", and f is differentiable 
ata point x € E. Then the partial derivatives (Dj, f,)(x) exist, and 


(27) F(xje, = S (D,fu, (1S Sm) 
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Here, as in Sec. 9.16, {e,,..., e,} and {u,,..., u,,} are the standard bases 
of R" and R”. 


Proof Fix j. Since f is differentiable at x, 

f(x + te;) — f(x) =f'(x)(te;) + r(te;) 
where |r(te;)|/t-+0 as t-+0. The linearity of f’(x) shows therefore that 
™ f(x + te,;) — f(x) 


(28) li = f'(x)e;. 
10 f 
If we now represent f in terms of its components, as in (24), then (28) 
becomes 
m f. fe.) —£ 
(29) lim J. a u; = f'(xJe,. 
t-0 i=1 


It follows that each quotient in this sum has a limit, as t + 0 (see Theorem 
4.10), so that each (D,/;)(x) exists, and then (27) follows from (29). 


Here are some consequences of Theorem 9.17: 
Let [f’(x)] be the matrix that represents f'(x) with respect to our standard 
bases, as in Sec. 9.9. 


Then f'(x)e; is the jth column vector of [f‘(x)], and (27) shows therefore 
that the number (D,/;)(x) occupies the spot in the /th row and jth column of 
[f’(x)]. Thus 


(Di fix) «°° (DAY) 
69) ieee ee 
(D, f(x) —_ (Di Sm)(X) 
If h = 2h;e; is any vector in R”, then (27) implies that 


(30) f'n =). | y (D fxr i u,. 


i=1\j= 


9.18 Example Let » be a differentiable mapping of the segment (a, b) c R’ 
into an open set E c R", in other words, y is a differentiable curve in E. Let f 
be a real-valued differentiable function with domain £. Thus fis a differentiable 
mapping of E into R’. Define 


(31) Gt) =f) (a<t<5). 


The chain rule asserts then that 


(32) IM=fOOWO @<t<6). 
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Since y'(t)e L(R'. R") and f'(y(t))€ LCR". R'). (32) defines g‘(t) as a linear 
operator on R'. This agrees with the fact that g maps (a. b) into R'. However. 
g(t) can also be regarded as a real number. (This was discussed in Sec. 9.10.) 
This number can be computed in terms of the partial derivatives of f and the 
derivatives of the components of y. as we shall now see. 

With respect to the standard basis {e,....,e,} of R”. [y(r)] is the 7 by | 
matrix (a “column matrix’’) which has y; (t) in the ‘th row, where y,..... y, are 
the components of y. Forevery x € E. [f'(x)] is the | by n matrix (a “row matrix’’) 
which has (D,f)(x) in the jth column. Hence [g’(t)] 1s the | by | matrix whose 
only entry is the real number 


(33) 9(0) = ¥ (DAA). 


This is a frequently encountered special case of the chain rule. It can be 
rephrased in the following manner. 

Associate with each xe E a vector, the so-called “‘gradient’’ of f at x, 
defined by 


(34) (VAX) = ¥ (DiS 008, 
Since 


(35) y(t) = Ly (the, 
(33) can be written in the form 
(36) 9 (t) = (VA) (CO. 


the scalar product of the vectors (Vf )(y(t)) and (1). 
Let us now fix an xe E, let ue R” be a unit vector (that is. |u} = 1). and 
specialize y so that 


(37) ye) =x 4+ (— 0 <t< o). 
Then »’(t) = u for every ¢. Hence (36) shows that 
(38) g (0) = (V)(x) * u. 
On the other hand, (37) shows that 
g(t) — g(0) = f(x + tu) — f(x). 
Hence (38) gives 


(39) lim I(x + tu) — f(x) 


1-0 t 


= (Vf) (x) -u. 
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The limit in (39) is usually called the directional derivative of f at x. in the 
direction of the unit vector u, and may be denoted by (D,/)(x). 

If f and x are fixed, but u varies, then (39) shows that (D,/)(x) attains its 
maximum when u is a positive scalar multiple of (V/)(x). [The case (Vf)(x) = 0 
should be excluded here. ] 

If u = Lu;e;, then (39) shows that (D,/)(x) can be expressed in terms of 
the partial derivatives of f at x by the formula 


(40) (D, fx) = Y (Dif Voom. 
Some of these ideas will play a role in the following theorem. 
9.19 Theorem Suppose f maps a convex open set E < R" into R", f is differen- 
tiable in E, and there is a real number M such that 
lf "(x)|| < M 
for every xe E. Then 
| f(b) — f(a)| < M|b —al| 
forallae E, be E. 
Proof Fixae E, be E. Define 
y(t) = (1 — tha + th 


for all te R' such that »(t)e E. Since E is convex, p(t)e E ifO<t< 1. 


Put 
g(t) = f (y(t). 
Then 
g(t) =f OM) OM =f OM) — a), 
so that 


[e'(t)| < HE'G@(O)I| |b — a] < |b — al 
for all te (0, 1]. By Theorem 5.19, 
|g(1) — g(0)| < M|b — al. 
But g(0) = f(a) and g(1) = f(b). This completes the proof. 


Corollary [/f, in addition, f'(x) =90 for all x € E, then f is constant. 


Proof To prove this, note that the hypotheses of the theorem hold now 
with M =0. 
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9.20 Definition A differentiable mapping f of an open set Ec R" into R™ is 
said to be continuously differentiable in E if f' is a continuous mapping of E 
into. LER", .R”). 


More explicitly, it is required that to every xe E and to every e>0 


corresponds a 6 > O such that 


f(y) -f(&)Ii<e 


ifye Eand |x —y|<o. 


If this is so, we also say that f is a G’-mapping, or that fe @‘(E). 


9.21 Theorem Suppose f maps an open set Ec R" into R". Then fe 6'(E) if 
and only tf the partial derivatives Df, exist and are continuous on E for \ <i<m, 
[es een 


(41) 


(42) 


Proof Assume first that fe @'(E). By (27), 
(D f(x) = (f'(x)e;) > u; 
for all i, 7. and for all x e E. Hence 
(D fy) — (Di AICO = {TE (y) — FP Ode;} - a 
and since |u,;| = |e;| = 1. it follows that 
(Dj fy) — (Di /IED| < [[E(y) — f’Oole;| 
< |lf'(y) — f(x) I. 


Hence Df; is continuous. 

For the converse, it suffices to consider the case m=1. (Why?) 
Fix x e E and ¢ >0. Since E is open, there is an open ball Sc E, with 
center at x and radius r. and the continuity of the functions D,f shows 
that r can be chosen so that 


\(D;fy) — (DVO) <= (ye Sj <m), 


Suppose h = Lh,e,. |h| <r, put vo = 90, andv, =hye, + °° + Aye, 
forl<k<n. Then 


Six +h) — fo) = ¥ [foe + ¥) — S00 + 4-0 


Since |v,| <r for 1 <k <nand since S is convex, the segments with end 
points x + v,;_, and x + v, lie in S. Since v; =v,;-, + fje;, the mean 
value theorem (5.10) shows that the jth summand in (42) 1s equal to 


h, D; f(x +V jap + 6, h;e;) 
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for some 0; € (0, 1), and this differs from h,(D,f)(x) by less than |/,|e/n. 
using (41). By (42), it follows that . 


n 1. 
f(x +h) ~ FO) — Y h{ D/O] <= Y |hjle <|hle 
j= j= 


for all h such that |h| <r. 

This says that f is differentiable at x and that /’(x) is the linear 
function which assigns the number £h,(D;f)(x) to the vector h = Lh,e;. 
The matrix [f’(x)] consists of the row (D, f)(x).....(D,f)(x); and since 
D,f, .... D,f are continuous functions on £, the concluding remarks of 
Sec. 9.9 show that fe @'(E). 


THE CONTRACTION PRINCIPLE 


We now interrupt our discussion of differentiation to insert a fixed point 
theorem that is valid in arbitrary complete metric spaces. It will be used in the 
proof of the inverse function theorem. 


9.22 Definition Let Y be a metric space, with metric d. If @ maps X into ¥ 
and if there is a number c < 1 such that 


(43) d(p(x), p(y) < ¢ d(x, y) 


for all x, ye X. then g is said to be a contraction of X into X. 


9.23 Theorem /f X is a complete metric space, and if @ is a contraction of X 
into X, then there exists one and only one x € X such that ~(x) = x. 


In other words, g has a unique fixed point. The uniqueness is a triviality. 
for if p(x) = x and gy) = y, then (43) gives d(x, )’) < c d(x, y). which can only 
happen when d(x, y) = 0. 

The existence of a fixed point of g is the essential part of the theorem. 
The proof actually furnishes a constructive method for locating the fixed point. 


Proof Pick x, € X arbitrarily, and define {x,,; recursively, by setting 
(44) Xe.) Sede « @ Sek &= >: 
Choose c < 1 so that (43) holds. For > 1 we then have 
AXn+ 15 Xn) = UP(Xn), PXn-1)) S A(X, Xn-1)- 
Hence induction gives 


(45) AC? 4, WD = C” Mer, XB) Or=@. le. 2. ..2:- 
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If n < m, it follows that 


ee b deme 


i=n+} 
eC ee re di 
<[(1 —c)~' d(x,, x9) Je". 


Thus {x,} is a Cauchy sequence. Since X is complete, lim x, = x for some 
MeuX. 

Since g is a contraction, @ is continuous (in fact, uniformly con- 
tinuous) on X. Hence 


gx)= lnne@@&,)=— lime... x. 
no 


nx 


THE INVERSE FUNCTION THEOREM 


The inverse function theorem states, roughly speaking, that a continuously 
differentiable mapping f is invertible in a neighborhood of any point x at which 
the linear transformation f’(x) is invertible: 


9.24 Theorem Suppose f is a 6'-mapping of an open set E < R" into R". f(a) 
is invertible for some ae E. and b = f(a). Then 


(a) there exist open sets U and V in R" such thatae U. be V.f is one-to- 
one on U, and f{(U) = V; 
(b) if g is the inverse of f [which exists, by (a)]. defined in V by 


g(f(x))=x  (xeU), 
thenge@(V). 


Writing the equation y = f(x) in component form. we arrive at the follow- 
ing interpretation of the conclusion of the theorem: The system of 1 equations 


Mm SPX >. . o9eX,,) (1 Seton) 


can be solved for x,,..., x, in terms of ),,..., 4,,. If we restrict x and y to small 
enough neighborhoods of a and b; the solutions are unique and continuously 
differentiable. 


Proof 
(a) Put f’(a) = A, and choose 4 so that 
(46) 2A A> fo 
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(47) 


(48) 


(49) 


(50) 


(51) 


Since f’ is continuous at a. there is an open ball Uc E, with center at a, 
such that 


If ‘(x) — Al] <2 (xe U). 
We associate to each y € R" a function ¢, defined by 
g(x)=x+A '@—f) me £). 

Note that (x)= y if and only if x is a fixed point of 9. 

Since g(x) = / — A~'f'(x) = A~'(A —f'(x)), (46) and (47) imply 
that 

lep(~Il<4 (xe U). 
Hence 
| p(x) — (x2)| < |x, — xQ| (x,, x, € U). 

by Theorem 9.19. It follows that g has at most one fixed point in U. so 


that f(x) = y for at most one xe U. 
Thus f is | — 1 in U. 


Next, put V =f(U), and pick yoeV. Then yo =f(x,) for some 
X) € U. Let B be an open ball with center at x9 and radius r > 0, so small 
that its closure B liesin U. We will show that y e V whenever |y — yo| < /r. 
This proves, of course. that V is open. 


Fix y, |y —yo| < 4r. With 9 as in (48). 


y r 
| (Xo) — Xo] = |A*(Y — Yo) < A 'llAr = 5. 


If x € B, it therefore follows from (50) that 
| P(x) — Xo] < | P(X) — —(X%o)| + | (Xo) — Xo| 
J ne 
i |x — Xo| +5sr 


hence g(x) € B. Note that (50) holds if x, € B, x, € B. 

Thus ¢ is a contraction of B into B. Being a closed subset of R”, 
B is complete. Theorem 9.23 implies therefore that g has a fixed point 
xe B. For this x. f(x) — y. Thus ye f(B) cf(U) = V. 

This proves part (a) of the theorem. 


(6) Pick yeV. y+keV. Then there exist xe U, x +heU, so that 
y =f(x), y+k=f(x +h). With g as in (48), 


g(x +h) — o(x) =h + Aq") — f(x + by) =h — Ak 
By (50), |h — A~'k| <4]h|. Hence | A~'k| >4}h]|, and 
[h] <2A~* | [kl =27'|k]. 
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By (46), (47), and Theorem 9.8, f’(x) has an inverse, say 7. Since 
g(y + k) — g(y) — Tk =h — 7k = —T [f(x + h) — f(x) — f’(x)h], 
(51) implies 


ley +k) — gy) — Tk] _ (ITI [f(x +h) — f(x) — £’Goh| 
[k| A |h| 

As k > 0, (51) shows thath— 0. The right side of the last inequality 

thus tends to 0. Hence the same is true of the left. We have thus proved 

that g’(y) = 7. But 7 was chosen to be the inverse of f’(x) = f‘(g(y)). Thus 


(52) g'(y) ={f'(ely))}"' = (ye V). 


Finally, note that g is a continuous mapping of V onto U (since g 
is differentiable), that f’ is a continuous mapping of U into the set Q of 
all invertible elements of /(R"). and that inversion is a continuous mapping 
of QO onto Q, by Theorem 9.8. If we combine these facts with (52), we see 
that ge @(V). 

This completes the proof. 


Remark. The full force of the assumption that fe @’(E) was only used 
in the last paragraph of the preceding proof. Everything else, down to Eq. (52), 
was derived from the existence of f’(x) for x € E, the invertibility of f’(a). and 
the continuity of f’ at just the point a. In this connection, we refer to the article 
by A. Nijenhuis in Amer. Math. Monthly. vol. 81, 1974, pp. 969-980. 

The following is an immediate consequence of part (a) of the inverse 
function theorem. 


9.25 Theorem /ff is a 6'-mapping of an open set E< R" into R" and if £'(x) 
is invertible for every x € E, then £{(W) is an open subset of R" for every open set 
Wee, 

In other words, f is an open mapping of E into R". 


The hypotheses made in this theorem ensure that each point x € E has a 
neighborhood in which f is 1-l. This may be expressed by saying that f is 
locally one-to-one in E. But f need not be I-1I in — under these circumstances. 
For an example, see Exercise 17. 


THE IMPLICIT FUNCTION THEOREM 


If f is a continuously differentiable real function in the plane, then the equation 
f(x. y) =0 can be solved for y in terms of x in a neighborhood of any point 
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(a, b) at which f(a, b) = 0 and cf/cy # 0. Likewise, one can solve for x in terms 
of y near (a, b) if cf/Cx #0 at (a. b). For a simple example which illustrates 
the need for assuming Cf/¢y ¥ 0, consider f(x, y) = x? + y? — 1. 

The preceding very informal statement is the simplest case (the case 
m=n=1 of Theorem 9.28) of the so-called “implicit function theorem.” Its 
proof makes strong use of the fact that continuously differentiable transformations 
behave locally very much like their derivatives. Accordingly, we first prove 
Theorem 9.27, the linear version of Theorem 9.28. 


9.26 Notation If x =(x,,..., %,)¢ R” and y =, ..« yy)e RR”, detus write 
(x, y) for the point (or vector) 


ee ee sa 


In what follows. the first entry in (x, y) or in a similar symbol will always be a 
vector in R”, the second will be a vector in R”. 

Every A € L(R"*”™, R") can be split into two linear transformations A, and 
A,, defined by 


(53) A,h = A(h, 0), Ak = A(0, k) 
for any he R", ke R”. Then A, € L(R"). A, € L(R”, R"), and 
(54) A(h, k) = A,h + A,k. 


The linear version of the implicit function theorem is now almost obvious. 


9.27 Theorem /f 4 € L(R"*”, R") and if A, is invertible, then there corresponds 
to every k € R™ a unique he R" such that A(h, k) = 0. 
This h can be computed from k by the formula 


(55) h = —(A,)"'A,k. 
Proof By (54). A(h, k) = 0 if and only if 
A,h+ A,k = 0, 
which is the same as (55) when A, is invertibie. 
The conclusion of Theorem 9.27 is, in other words, that the equation 
A(h. k) = 0 can be solved (uniquely) for h if k is given, and that the solution h 


is a linear function of k. Those who have some acquaintance with linear algebra 
will reccgnize this as a very familiar statement about systems of linear equations. 


9.28 Theorem Le: f be a ¢’-:mapping of an open set E< R"*™ into R", such 
that f(a. b) = 0 for some point (a, b) é€ E. 
Put A =f'(a, b) and assume that A, is invertible. 
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Then there exist open sets Uc R"*™" and Wc R", with (a,b) e U and 
be W. having the following property: 
To every y € W corresponds a unique x such that 


(S6) (x. y)e U and fix, |) = 0. 
If this x is defined to be gy). then g is a G'-mapping of W into R", g(b) =a, 
(57) {go).w =9 We, 
and 
(58) g’(b) = —(A,)"'A,. 


The function g is “implicitly” defined by (57). Hence the name of the 


theorem. 
The equation f(x. y) =0 can be wrilten as a system of 7» equetions in 
n+m variables: 


Filxy vere Xe Jy sscinaa laced) 9) 
(59) Oo CAGOnnGeE Cstsc cd Obrn o Gt po th Gibeo.oe a 3 
fie. Nas y1 —"s By) =0 
The assumption that 4, is invertible means that the » by # matrix 
Dif; DSi 
By, ia Dial 


evaluated at (a. b) defines an invertible linear operator in A": in other words, 
its column vecters should be independent, or. equivalently. its determinant 
should be +0. (See Theorem 9.36.) If. furthermore. (S9) holds when ¥ = a and 
y ="b, then the conelusiomef the theorem is that (59) can besolved for y,...... a 
in terms of y,,.... »,,. for every y near b, and that these solutions are continu- 
ously differentiable functions of y. 


Proof Define F by 
(60) Pe. PS (fe. yy yr (®& we £). 


Then F is a @’-mapping of F into R"’™. We claim that F(ab) is an 
invertible element of 1(R"*”): 
Since f(a. b) = 0, we have 


f(a +h, b +k) = Ath, k) + r(h. k). 
where r is the remainder that occurs in the definition of f'(a.b). Since 


F(a + h, b + k) — F(a, b) = (f(a +h, b + kK), k) 
= (Ath, k), k) + (r(h. k), 0) 


226 PRINCIPLES OF MATHEMATICAL ANALYSIS 


(61) 


(62) 


(63) 


(64) 


(65) 


it follows that F’(a. b) is the linear operator on R"*™ that maps (h, k) to 
(A(h, k), k). If this image vector is 0, then A(h, k) = 0 and k = 0, hence 
A(h, 0) = 0, and Theorem 9.27 implies that h = 0. It follows that F(a. b) 
is 1-1; hence it is invertible (Theorem 9.5). 

The inverse function theorem can therefore be applied to F. It shows 
that there exist open sets U and V in R"’*™, with (a, b) € U, (0. b) € V, such 
that F is a 1-1 mapping of U onto V. 

We let W be the set of all ye R” such that (0, y)e V. Note that 
be W. | 

It is clear that W is open since V is open. 

If y € W, then (0, y) = F(x, y) for some (x, y) € U. By (60). f(x, y) =90 
for this x. 

Suppose, with the same y, that (x’, y)e U and f(x’, y) =9. Then 


F(x’, y) = (f(x’, y), y) = (f(x. y). y) = F(x, y). 


Since F is 1-1 in U, it follows that x’ = x. 
This proves the first part of the theorem. 


For the second part, define g(y), for ye W. so that (g(y). y) € U and 
(57) holds. Then 


F(g(y). y) = (0. y) (y e W). 


If G is the mapping of V onto U that inverts F, then G € @’, by the inverse 
function theorem, and (61) gives 


(g(y).y)=G(O,.y) (ye Ww). 


Since G € @’, (62) shows that ge @’. 
Finally, to compute g’(b), put (g(y), y) = ®(y). Then 


(yk =(g(y)k,k) (ye W, ke R”). 
By (57), f(@(y)) =0 in W. The chain rule shows therefore that 
f'(P(y))®(y) = 0. 
When y = b, then ®(y) = (a, b), and f (®(y)) = A. Thus 
A®'(b) = 0. 
It now follows from (64), (63), and (54), that 
A,g(b)k + A,k = A(g'(b)k, k) = A®'(b)k = 0 
for every ke R”. Thus 
A,g (b) + A, =0. 
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This is equivalent to (58), and completes the proof. 


Note. In terms of the components of f and g, (65) becomes 


¥ (D fila, 1D. 9b) = —(Dy sf.) 


where | 1 eR, ] <k<m. 


For each k, this is a system of n linear equations in which the derivatives 
0g ;/0y, (1 <j <n) are the unknowns. 


or 


9.29 Example Take n = 2, m =3, and consider the mapping f = (/,,/,) of 
R° into R? given by 
F(X 1, X25 Vis V2, V3) = 2" + x2, — 4y2 + 3 
S2(%15 X25 V1» V2, V3) = Xz COS X,— 6X, + 2y, — ys. 
Ifa = (Op T)iandsb:= (3P2P7) mthen"f (a: b) =0. 
With respect to the standard bases, the matrix of the transformation 
A =f {a, b) is 


7 3 | =a 
=| _5 wes =i 


d= | 6 1" Biss ea 


We see that the column vectors of [A,] are independent. Hence A, is invertible 

and the implicit function theorem asserts the existence of a @’-mapping g, defined 

in a neighborhood of (3, 2, 7), such that g(3, 2, 7) = (0, 1) and f(g(y), y) = 0. 
We can use (58) to compute g’(3, 2, 7): Since 


Hence 


[(A.)"'] = [4.7"" = Is | 


(58) gives 


ee.2M=-5(5 Ih ~o il-[-3 4 “3 
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In terms of partial derivatives, the conclusion is that 
Dig, =4 D239, =4 D39; = —75 
Dyg2 = —4 D292 =$% D392 =75 
at the point (3, 2, 7). 


THE RANK THEOREM 


Although this theorem is not as important as the inverse function theorem or 
the implicit function theorem, we include it as another interesting illustration 
of the general principle that the local behavior of a continuously differentiable 
mapping F near a point x is similar to that of the linear transformation F’(x). 

Before stating it, we need a few more facts about linear transformations. 


9.30 Definitions Suppose X¥ and Y are vector spaces. and Ae L(X, Y), as in 
Definition 9.6. The null space of A, (A), is the set of all x € X¥ at which Ax = 0. 
It is clear that (A) is a vector space in YX. 

Likewise, the range of A, @(A), is a vector space in Y. 

The rank of A is defined to be the dimension of &(A). 

For example, the invertible elements of L(R") are precisely those whose 
rank isn. This follows from Theorem 9.5. 

If Ae L(X, Y) and A has rank 0, then Ax = Ofor all xe A, hence.4"(A) = 
In this connection, see Exercise 25. 


9.31 Projections Let X be a vector space. An operator P € L(X) is said to be 
a projection in X if P? =P. 

More explicitly, the requirement is that P(Px) = Px for every xe X. In 
other words, P fixes every vector in its range A#(P). 

Here are some elementary properties of projections: 


(a) If P is a projection in X, then every x € X has a unique representation 
of the form 


X=X,+X, 


where x, € A(P), x, € NW (P). 

To obtain the representation, "put x, =9Px, x, =x—x,. Then 
Px, = Px — Px, = Px — P*?x =0. As regards the uniqueness. apply P to 
the equation x = x, + x,. Since x, € A(P), Px, = x,; since Px,,= 0, it 
follows that x, = Px. 
(b) If X is a finite-dimensional vector space and if X, is a vector space in 
X, then there is a projection P in X with &(P) = X,. 
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If X, contains only 0, this is trivial: put Px = 0 for all x e YX. 
Assume dim X, =k >0. By Theorem 9.3, X has then a basis 
{u,,..., U,} such that {u,,..., u,} is a basis of X,. Define 


ree, +: + ea =te, + +: Fou 


for arbitrary scalars c,,..., C,. 
Then Px =x for every xe X,, and X, = &(P). 
Note that {u,,,,..., u,} 1s a basis of W(P). Note also that there are 


infinitely many Realittions in X, with range X,, if 0 < dim X, < dim X. 


9.32 Theorem Suppose m.n, r are nonnegative integers, m>r.n>r,F isa 
€ '-mapping of an open set E < R" into R”, and F(x) has rank r for every x € E. 
Fix ae E, put A = F(a), let Y, be the range of A, and let P be a projection 
in R™ whose range is Y,. Let Y, be the null space of P. 
Then there are open sets U and V in R", withae U, Uc E, and there is a 
1-1 @'-mapping H of V onto U (whose inverse is also of class @') such that 


(66) F(H(x)) = Ax + @(Ax) (xe V) 
where ~— is a 6'-mapping of the open set A(V) < Y, into Y,. 


After the proof we shall give a more geometric description of the informa- 
tion that (66) contains. 


Proof If r=0, Theorem 9.19 shows that F(x) is constant in a neighbor- 
hood U of a, and (66) holds trivially, with V = U, H(x) = x, p(0) = F(a). 

From now on we assume r > 0. Since dim Y, =r, Y, has a basis 
{y,,..-, y,}. Choose z; € R"so that Az; = y;(1 <i <1), and define a linear 
mapping S of Y, into R” by setting 


(67) Sey, + +GY) = Crt + + GZ, 


fogeall scalars.cy, aa:..Cp: 
When ASy,; = Az, = y; fer l.<i <7. Virus 


(68) ASy=y (ye Y,). 
Define a mapping G of E into R” by setting 
(69) G(x) = x + SP[F(x) — Ax] (x € E). 


Since F(a) = A. differentiation of (69) shows that G’(a) = /. the identity 
operator on R". By the inverse function theorem, there are open sets U 
and V in R", with ae U, such that G is a !-1 mapping of U onto V whose 
inverse H is also of class G’. Moreover, by shrinking U and V. if necessary. 
we can arrange it so that V is convex and H(x) is invertible for every x € V. 
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(70) 


(71) 


(72) 


(73) 


(74) 


(75) 


(76) 


(77) 


(78) 


Note that ASPA = A, since PA = A and (68) holds. Therefore (69) 
gives 
AG(x) = PF(x) (x € E). 
In particular, (70) holds for xe U. If we replace x by H(x). we obtain 
PF(H(x)) = Ax (xe V). 
Define 
W(x) = F(H(x)) — Ax (xe V). 
Since PA = A, (71) implies that Py(x) =90 for all xe V. Thus w is a 
@'-mapping of V into Y,. 
Since V is open, it is clear that A(V) is an open subset of its range 
R(A) = Yj. 
To complete the proof, i.e., to go from (72) to (66). we have to show 
that there is a @’-mapping ~ of A(V) into Y, which satisfies 
p(Ax) = (x) (xeV). 
As a step toward (73), we will first prove that 


W(X1) = W(X2) 
if x, €V,&, eV, Ak, = Ax. 
Put ®(x) = F(H(x)), for xe V. Since H’(x) has rank » for every 
x € V, and F’(x) has rank r for every x € U, it follows that 


rank ®’(x) = rank F’(H(x))H'(x) =r (xe V). 
Fix xe V. Let M be the range of ®’(x). Then Mc R™, dim M =r. 
By (71), 
PS’) =.A: 


Thus P maps M onto @(A) = Y,. Since M and Y, have the same di- 
mension, it follows that P (restricted to M) is 1-1. 

Suppose now that Ah=0. Then P®(x)h=0, by (76). But 
@'(x)h e M, and P is 1-1 on M. Hence @’(x)h = 0. A look at (72) shows 
now that we have proved the following: 

Ifx eV and Ah = 0, then W'(x)h = 0. 

We can now prove (74). Suppose x, € V. x, e V, Ax, = Ax,. Put 
h = x, — x, and define 


g(t) = W(x, + th) @ 27 21). 
The convexity of V shows that x, + the V for these t. Hence 


g(t) ='(x, + thh =0 C=1<F 
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so that g(1) = g(0). But g(1) = W(x,) and g(0) = W(x,). This proves (74). 
By (74), (x) depends only on Ax, for xe V. Hence (73) defines @ 
unambiguously in A(V). It only remains to be proved that ge @’. 
Fix yo € A(V), fix x9 € V so that Axg = yo. Since V is open, yy has 
a neighborhood W in Y, such that the vector 


(79) X = Xo + S(y — yo) 
lies in V for allye W. By (68), 
Ax = AXy +Y¥Y —Yo =. 
Thus (73) and (79) give 
(80) P(Y) = W(X — Syo + Sy) = (ye W). 


This formula shows that g € @’ in W, hence in A(V), since yy was chosen 
arbitrarily in A(V). 
The proof is now complete. 


Here is what the theorem tells us about the geometry of the mapping F. 
If ye F(U) then y = F(H(x)) for some x € V. and (66) shows that Py = Ax. 
Therefore 


(81) y=Py+(Py) (yeF(U)). 


This shows that y is determined by its projection Py, and that P, restricted 
to F(U), is a |-] mapping of F(U) onto A(V). Thus F(U) ts an ‘‘r-dimensional 
surface” with precisely one point “‘over’” each point of A(V). We may also 
regard F(U) as the graph of g. 

If ®(x) = F(H(x)), as in the proof, then (66) shows that the level sets of ® 
(these are the sets on which ® attains a given value) are precisely the level sets of 
A in V. These are “‘flat’’ since they are intersections with V of translates of the 
vector space .V(A). Note that dim (A) =n — r (Exercise 25). 

The level sets of F in U are the images under H of the flat level sets of ® 
in V. They are thus “(m7 — r)-dimensional surfaces” in U. 


DETERMINANTS 


Determinants are numbers associated to square matrices, and hence to the 
operators represented by such matrices. They are 0 if and only if the corre- 
sponding operator fails to be invertible. They can therefore be used to decide 
whether the hypotheses of some of the preceding theorems are satisfied. They 
will play an even more important role in Chap. 10. 
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9.33 Definition If (j,,..../,) is an ordered n-tuple of integers, define 


(82) SC, ses J) = I] sgn a =J) 

p<q 
where sgn x = 1 if x >0, sgnx=-—1 if x <0, sgnx=0 if x =0. Then 
S(j1,+-.>Jn) =1, —1, or 0, and it changes sign if any two of the /’s are inter- 
changed. 

Let [A] be the matrix of a linear operator A on R”. relative to the standard 
basis {e,,..., e,}, with entries a(i, j) in the ith row and jth column. The deter- 
minant of [A] is defined to be the number 
(83) det [A] - > SC), eC » Ina, J, )a(2, j2) = a(n, jn). 


The sum in (83) extends over all ordered n-tuples of integers (j;,...,,) with 
lsgoen 


The column vectors x; of [A] are 
(84) x, = > ati, je; (l<j<n). 
=1 
It will be convenient to think of det [A] as a function of the column vectors 
of [A]. If we write 
det (m,, ..., X,) = det {A}, 


det is now a real function on the set of all ordered n-tuples of vectors in R’. 


9.34 Theorem 
(a) If is the identity operator on R", then 
det {/] = det (e,, ...,e) = I. 

(6) det is alinear function of each of the column vectors x, , if the others are 
held fixed. 

(c) If [A], is obtained from [A] by interchanging two columns, then 
det [A], = —det [A]. 

(d) If [A] has two equal columns, then det [A] = 0. 


Proof If A =/, then a(i,i) =1 and a(i,j) =0 for i #7. Hence 
e607) =s@. 2,2... m= 


which proves (a). By (82), 5(j,..-..J,) = 0 if any two of the j’s are equal. 
Each of the remaining ! products in (83) contains exactly one factor 
from each column. This proves (6). Part (c) is an immediate consequence 
of the fact that s(j,,...,/,) Changes sign if any two of the /’s are inter- 
changed, and (d) is a corollary of (c). 


9.355 


(85) 


(86) 


(87) 


(88) 


(89) 


9.36 


(90) 
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Theorem /f [A] and [B] are n by n matrices, then 
det ({BJ[A]) = det [B] det [A]. 
Proof If x,...., x, are the columns of [A], define 
Aigl% 1... %) = Ag[A] = det ([B]{A}). 
The columns of [B][A] are the vectors Bx,,..., Bx,. Thus 
AEOG..... X,,) =det (BK), ..., Bx). 


By (86) and Theorem 9.34, A, also has properties 9.34 (6) to (d). By (db) 
and (84), 


AylA} = A, (> ati. WEF. Bes...” x) = al) Axe: x, ..., x) 


Repeating this process with x,,..., X,, we obtain 
AglA] = diy, Lali, 2) +++ ai, m) Ag(e;,, ..-, &;,), 


the sum being extended over all ordered n-tuples (/,...., /,) with 
l<i,<n. By (c) and (d). 


CEC s--. MG, ,. .. LRes - - - ane); 
where ¢ = 1, 0, or —1, and since [B][/] = [B]. (85) shows that 
Ayle,.... epee). 
Substituting (89) and (88) into (87), we obtain 
oat (Bie) = ea 1) Re, odie, .. i,)} det [B], 
for all by # matrices [A] and [B]. Taking B =/, we see that the above 
sum in braces is det [A]. This proves the theorem. 
Theorem 4 /inear operator A on R" is invertible if and only if det [A] #0. 
Proof If A is invertible, Theorem 9.35 shows that 
det [A] det [A~'] = det [4A~'] = det [/] =], 

so that det [A] #0. 


If A is not invertible, the columns x,. ..., xX, Of [A] are dependent 
(Theorem 9.5); hence there is one, say, x,. such that 


x, + ) cjx,; =0 
j#k 


for certain scalars c;. By 9.34 (6) and (d). x, can be replaced by xy + ¢;X, 
without altering the determinant, if j #&k. Repeating, we see that x, can 
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be replaced by the left side of (90), i.e., by 0. without altering the deter- 
minant. But a matrix which has 0 for one column has determinant 0. 
Hence det [A] = 0. 


9.37 Remark Suppose {e,,...,¢,} and {u,,...,u,} are bases in R”. 
Every linear operator A on R" determines matrices [A] and [A], with entries 
a;; and a;;, given by 


Ae; = ), Gi; Sie Au; =) a;;U;. 


If u; = Be; = £b;,;e;, then Au, is equal to 
2 My, Be _ 2, jd Din@s = » (> bin Ms) ™ 
and also to 
ABe; = A 2 bse = yy (2 in Px.) e;. 


Thus 2);,%,; = La;,b,;, OF 
(91) [B}[A]y = [A][B). 


Since B is invertible, det [B] #0. Hence (91), combined with Theorem 9.35, 
shows that 


(92) det [A], = det [A]. 


The determinant of the matrix of a linear operator does therefore not 
depend on the basis which is used to construct the matrix. /t is thus meaningful 
to speak of the determinant of a linear operator, without having any basis in mind. 


9.38 Jacobians .If f maps an open set E < R" into R", and if f is differen- 
tiable at a point xe E, the determinant of the linear operator f’(x) is called 
the Jacobian of f at x. In symbols, 


(93) J (x) = det f’(x). 
We shall also use the notation 


GH,....., ie 


on (eee 


for J.(x), 4F (9j,...225 Bai... 3 ie): 

In terms of Jacobians, the crucial hypothesis in the inverse function 
theorem is that J,(a) #0 (compare Theorem 9.36). If the implicit function 
theorem is stated in terms of the functions (59), the assumption made there on 
A amounts to 


of, — 


—————. £0. 
OGy.. . cap - 
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DERIVATIVES OF HIGHER ORDER 


9.39 Definition Suppose f is a real function defined in an open set Ec R", 
with partial derivatives D,f.....D,f- If the functions D,f are themselves 
differentiable, then the second-order partial derivatives of f are defined by 


D,,f = D, Df CO. J Vere Oh 


If all these functions D;,f are continuous in FE, we say that fis of class @” in E, 
or that fe G’(E). 

A mapping f of E into R™ is suid to be of class G” if each component of f 
is of class @”. 

It can happen that D;,f # D,,f at some point, although both derivatives 
exist (see Exercise 27). However, we shall see below that D;,f = D;,f whenever 
these derivatives are continuous. 

For simplicity (and without loss of generality) we state our next two 
theorems for real functions of two variables. The first one is a mean value 
theorem. 


9.40 Theorem Suppose f is defined in an open set E < R’, and D,f and D,,f 
exist at every point of FE. Suppose Q < E is a closed rectangle with sides parallel 
to the coordinate axes, having (a,b) and (a+h,b+k) as opposite vertices 
(h #0, k #0). Put 


A(f. Q) =f(at+h.b+k)—f(at+h, b) —f(a.b +k) + f(a, b). 
Then there is a point (x, y) in the interior of Q such that 
(95) AC, QO) = hk( Da, f(x. y). 
Note the analogy between (95) and Theorem 5.10; the area of Q is hk. 


Proof Put u(t) = f(t.b +k) — f(t, 6b). Two applications of Theorem 5.10 
show that there is an x between a and a + A, and that there is a y between 
b and b +k, such that 


A(f. Q) = u(a + h) — u(a) 
= hu'(x) 
= Al(D, f(x. b +k) — (Di f(x. by] 
= hk(D,, f(x. ¥). 
9.41 Theorem Suppose f is defined in an open set E < R’. suppose that Dyf, 


D,,f. and D,f exist at every point of E, and D,,f is continuous at some point 
(a, bye E. 
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(96) 


Then D,3f exists at (a, b) and 
(D,2f (a, 6) = (D2, f (a. b). 


Corollary D,,f = D,,f if fe 6(E). 


(97) 


Proof Put A =(D,,f)(a.b). Choose e>0. If Q is a rectangle as in 
Theorem 9.40. and if 4 and k are sufficiently small, we have 


|A — (Da, fx. v)| <é 
for all (x. y)€Q. Thus 


A(f. Q) 
hk 


by (95). Fix A, and let k +0. Since D,/f exists in E, the last inequality 
implies that 


- A) <e 


(D, f(a + h, b) — (D, fa. 6) a 
h 


Since ¢ was arbitrary, and since (97) holds for all sufficiently small 
h #0, it follows that (D,,/f)(a, b) = A. This gives (96). 


Aubsuc. 


DIFFERENTIATION OF INTEGRALS 


Suppose ¢ is a function of two variables which can be integrated with respect 
to one and which can be differentiated with respect to the other. Under what 
conditions will the result be the same if these two limit processes are carried out 
in the opposite order? To state the question more precisely: Under what 
conditions on g can one prove that the equation 


(98) 


dp -» ep 
= | pla; t):dxe= |) - (x. Max 


a 


is true? (A counter example is furnished by Exercise 28.) 


(99) 


It will be convenient to use the notation 


p(x) = p(x, ft). 


Thus ¢' is, for each ft, a function of one variable. 


9.42 Theorem Suppose 


(a) (x, t) is defined fora<x<b,c<t<d; 
(b) x is an increasing function on [a, b}; 
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(c) g'€ A(z) for every te [c, d]; 

(d) c<s<d, and to every & > 0 corresponds a 6 > 0 such that 
| (Dz p(x, t) — (Dz g(x, 5)| <e 

for all x € [a, b] and for all te (s — 6, 5 + 8). 


Define 
(100) fit) =[ocetydax) (ext). 


“a 


Then (D, oy € A(x), f(s) exists, and 


b 
(101) f(s) = | (D1 ex, 8) dad. 


Note that (c) simply asserts the existence of the integrals (100) for all 
te [c, d]. Note also that (d) certainly holds whenever D, ¢ is continuous on the 
rectangle on which ¢ is defined. 


Proof Consider the difference quotients 


te DH P(x, -— 5) 


for 0< |t —s| <6. By Theorem 5.10 there corresponds to each (x, f) a 
number wu between s and ¢ such that 


W(x, t) = (D, ox. uv). 
Hence (d) implies that 
(102) | W(x, t) — (D, p(x, 5)| <e (qax = b, 0 < lt —w| =o). 
Note that 


t)y—J 2 
(103) ) _ il W(x, t) da(x). 
t—S i 
By (102), w'—>(D,¢)*, uniformly on [a, 5], as ts. Since each 
w' € A(x), the desired conclusion follows from (103) and Theorem 7.16. 


9.43 Example One can of course prove analogues of Theorem 9.42 with 
(— 00, 00) in place of [a,b]. Instead of doing this, let us simply look at an 
example. Define 


(104) S(t) = | e~* cos (xt) Ax 


—@ 
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and 


(105) g(t) = — li Xo TUX, 


for —«o <t< oo. Both integrals exist (they converge absolutely) since the 
absolute values of the integrands are at most exp (—x’) and |x| exp (—x?). 
respectively. 

Note that g is obtained from / by differentiating the integrand with respect 
to t. We claim that f is differentiable and that 


(106) TO zg) (—0 <t< o). 


To prove this, let us first examine the difference quotients of the cosine: 

if B > 0, then 
cos (x + B) — cos f bags? FP 
(107) ick lien +sinx=- { (sin x — sin t) dt. 
B B va 

Since |sin x — sint| < |t — x], the right side of (107) is at most 8/2 in absolute 
value; the case Pp < 0 is handled similarly. Thus 
cos (x + f) — cos x 


B 


for all f (if the left side is interpreted to be 0 when f = 0). 
Now fix ¢. and fix h #0. Apply (108) with x = xt, B = xh; it follows from 
(104) and (105) that 


Ae hy fo 
h 


(108) < |p| 


+ sin x 


g(t)| < hl | ee alg 
When h > 0, we thus obtain (106). 
Let us go a step further: An integration by parts. applied to (104). shows 


that 
(109) f(t) = a xe 


_,2 sin ab ” 


Thus ¢f(t) = — 29(t), and (106) implies now that f satisfies the differential 
equation 


(110) 2f'(t) + tf(t) = 0. 


If we solve this differential equation and use the fact that f(0) = ./n (see Sec. 
8.21), we find that 


(111) f(t) = ./nexp i ‘). 


The integral (104) is thus explicitly determined. 
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EXERCISES 


10. 


If S is a nonempty subset of a vector space X, prove (as asserted in Sec. 9.1) that 
the span of S is a vector space. 


. Prove (as asserted in Sec. 9.6) that B4 is linear if .4 and Bare linear transformations. 


Prove also that A~' is linear and invertible. 


. Assume A € L(X, Y) and Ax 0 only when x = 0. Prove that 4 is then 1-1. 


. Prove (as asserted in Sec. 9.30) that null spaces and ranges of linear transforma- 


tions are vector Spaces. 


. Prove that toevery 4 = L(R". R') corresponds a unique y € R” such that Ax = x-ry. 


Prove also that A; = |y|. 
Hint: Under certain conditions, equality holds in the Schwarz inequality. 


. If f(0,0) Oand 


fxy) te if (x, ») = (0, 0), 


prove that (D, f)(*. ¥) and (D;f)(x, ») exist at every point of R?, although / is 
not continuous at (0, 0). 


. Suppose that f is a real-valued function defined in an open set E < R”, and that 


the partial derivatives D, f,.... D,f are bounded in E. Prove that f is continuous 
im E. 
Hint; Proceed as in the proof of Theorem 9.21. 


. Suppose that fis a differentiable real function in an open set E < R", and that f 


has a local maximum at a point x € E. Prove that f(x) = 0. 


. If f is a differentiable mapping of a connected open set E < R" into R”, and if 


f(x) = 0 for every x € E, prove that f is constant in E. 
If fis a real function defined in a convex open set E < R*. such that (D, f(x) = 0 
for every x € E, prove that f(x) depends only on +2,..., Xn. 

Show that the convexity of E can be replaced by a weaker condition, but 
that some condition is required. For example, if 7 = 2 and E is shaped like a 
horseshoe, the statement may be false. 


. If fand g are differentiable real functions in R”, prove that 


Sup -f €o9~ oUF 


and that Vil f) -/f-?Vf wherever f = 0. 


. Fix two real numbers a and 6.0. a~- hb. Define a mapping f (fi. f>. fs) of R? 


into R° by 
fi(s,t) —(b + acoss)cost 
fs,t) (b+ acoss)sint 


Ses, the @ Sites. 
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a3 


14. 


15; 


Describe the range K of f. (It is a certain compact subset of R°*.) 
(a) Show that there are exactly 4 points p € K such that 


(Vf: )(F- “(p)) = 9. 


Find these points. 
(6) Determine the set of all q € K such that 


(Vfs)(£- "(q)) = 0. 


(c) Show that one of the points p found in part (a) corresponds to a local maxi- 
mum of /;, one corresponds to a local minimum, and that the other two are 
neither (they are so-called “saddle points’’). 

Which of the points q found in part (5) correspond to maxima or minima? 
(d) Let A be an irrational real number, and define g(r) = f(t, Ar). Prove that g is a 
1-1 mapping of R' onto a dense subset of K. Prove that 


|g’(t)| 2 = a? + A*(6 + acosf)?. 


Suppose f is a differentiable mapping of R' into R* such that |f(t)| = 1 for every f. 
Prove that f(r) f(t) = 0. 
Interpret this result geometrically. 


Define /(0, 0) = 0 and 


3 


OS er reer MS) 


(a) Prove that D, fand D, fare bounded functions in R?. (Hence / is continuous.) 
(b) Let u be any unit vector in R?. Show that the directional derivative (D,/)(0, 0) 
exists, and that its absolute value is at most 1. 
(c) Let y be a differentiable mapping of R' into R? (in other words, y is a differ- 
entiable curve in R?), with (0) = (0, 0) and |y(0)| >0. Put g(r) = f(y(1)) and 
prove that g is differentiable for every ¢ € R’. 

If ye @’, prove that g € @’. 
(d) In spite of this, prove that fis not differentiable at (0, 0). 

Hint; Formula (40) fails. 


Define f(0, 0) = 0, and put 


4x®y? 


I(x, y) = x? + y? — 2xty — ag?) 


if (x, y) # (0, 0). 
(a) Prove, for all (x, y) € R?, that 
4x*y? =< + yo. 


Conclude that / is continuous. 


16. 


i 


18 


19. 


20. 


Zi 
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(6) For 0 <0 < 27, — + —1 = @, define 
golt)= f(t cos 6,4 sin A). 


Show that go(0) = 0, go(O) = 0, gf(0) = 2. Each go has therefare a strict local 
minimum at 4 = 0. 

In other words, the restriction of f to each line through (0, 0) has a strict 
local minimum at (0, 0). 
(c) Show that (0, 0) is nevertheless not a local minimum for f, since f(x, x?) = -- x4, 
Show that the continuity of f at the peint a is needed in the inverse function 
theorem, even in the case = |: If 


| 
flth= (+0217 Gin (*) 


for += 0, and /(0)= 0, then /(0)= 1, f’ is bounded in (— 1,1), but f is not 
one-to-one in any neighborhood of 0. 
Let f= (/,. /:) be the mapping of R? into R? given by 


fix, =e" COBY, file) = ce sine’. 
(a) What is the range of f? 
(») Show that the Jacobian of fis not zero at any point of R?. Thus every point 


of R? has a neighborhood in which / is one-to-one. Nevertheless, fis not one-to- 
one on R?. 

(c) Put a == (0, 7/3), b= f(a), let g be the continuous inverse of f, defined in a 
neighborhood of b. such that g(b)= a. Find an explicit formula for g, compute 
f(a) and g(b), and verify the formula (52). 

(<1) What are the images under f of lines parallel to the coordinate axes? 

Answer analogous questions for the mapping defined by 


ia (== 2h:. 
Show that the system of equations 
3x+ y—z+uW?=0 
x—y+2:+u=0 
2+ 2y --3z2+ 2u=0 
can be solved for x, 3, «in terms of 2; for x, 2, win terms of 1; for y, 2, 4 in terms 


of x; but not for x, y, z in terms of w. 
Take = m= 1 in the implicit function theorem. and interpret the theorem (as 


well as its proof) graphically. 
Define fin R? by 
S (x, y) = 2x? — 3x? + 2y? + By?. 
(a) Find the four points in R? at which the gradient of fis zero. Show that Shas 
exactly one local maximum and one local minimum tn R?. 
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22. 


23. 


24. 


25: 


26. 


27. 


28. 


(b) Let S be the set of all (v, ¥) © R? at which f(x, ») = 0. Find those points of 
S that have no neighborhoods in which the equation f(x, )) =90 can be solved for 
y in terms of x (or for x in terms of y). Describe S as precisely as you can. 
Give a similar discussion for 


S65. = 2a -aoey* -- 3 Sy? 
Define fin R* by 
Som Dis daz) = ra -— e* 4 Me A 


Show that /(0, 1, —1) = 0,(D,/)(0, !, —1) #0, and that there exists therefore a 
differentiable function g in some neighborhood of (1, 1) in R*, such that 
g(t, —1)=: 0 and 


f(g, 2), Vis y2) aa 0. 
For (x, y) 4 (0, 0), define f = (fi, f2) by 


x? Pe. 2 ; 
a 9 ee y) = 


x} 
J igiaey.? 


fi (x, y) = 


x?ay 


Compute the rank of f(x, y), and find the range of f. 

Suppose A € L(R", R”), let r be the rank of A. 

(a) Define S as in the proof of Theorem 9.32. Show that S4 ts a projection in R" 
whose null space is .4°(A) and whose range is A(S). Hint: By (68), SASA SA. 
(b) Use (a) to show that 


dim (A) :- dim A(A) = n. 


Show that the existence (and even the continuity) of D,.f does not imply the 
existence of D, f. For example, let f(x, )’) = g(x), where g is nowhere differentiable. 
Put /(0, 0) = 0, and 


wie y*) 
nae a Se 


f(x, y) = 


if (x, ») 4 (0, 0). Prove that 

(a) f, D, f, D.f are continuous in R?; 

(6) Di2fand D2, fexist at every point of R?, and are continuous except at (0, 0); 
(c) (Di2f)(0, 0) = 1, and (D2, f)O, 9) = 1. 

For ¢t > 0, put 


x _— Ogemecace) 
flea iat ax I Ol meine 2V 1) 
0 (otherwise), 


and put 9(x, tf) = —9(x, |t|) if t<9. 


29. 


30. 
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Show that m is continuous on R?, and 
(D, Px, 0) 0 


for all x. Define 
f(t) [. p(x, t) dx. 
Show that f(t) = rif |r| <4. Hence 
Said [ C D.9)(x, 0) dx. 


Let E be an open set in R". The classes G‘(E) and 6“(E) are defined in the text. 
By induction, 6“ (E) can be defined as follows, for all positive integers k: To say 
that fe G“(E) means that the partial derivatives D, f,..., D, f belong to G“*~ '(E). 

Assume fe 6“ (E), and show (by repeated application of Theorem 9.41) 
that the Ath-order derivative 


Ditis ers Te de Dav, aiale D7 


is unchanged if the subscripts /,,..., 4% are permuted. 
For instance, if 7 >> 3, then 


Ds 3545. f= Dsii2f 
for every fe G™. 


Let fe 6‘"(E), where E is an open subset of R". Fix ae F, and suppose x € R" 
is so close to 0 that the points 


pi)=— a + tx 
lie in E whenever 0 <7 <1. Define 
h(t) = f(p(t)) 


for all ¢ € R' for which p(t) € E. 
(a) For | <k <™m, show (by repeated application of the chain rule) that 


Ah) =>. (Di, pete it (p(t)) Mig css Ng > 


The sum extends over all ordered k-tuples (/,, ..., 4,) in which each /, is one of the 


integers 1,..., 7”. 
(b) By Taylor's theorem (5.15), 


m-1 AlkKyg hom (rt 
MI = 2 Fi + — 


for some ¢ € (0, 1). Use this to prove Taylor’s theorem in 1 variables by showing 
that the formula 
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m-1 1 
f(a+ x)= ~ kia CD; «if ON, Hi TR) 
k=0 ° 
represents f(a + x) as the sum of its so-called “Taylor polynomial of degree 
m— 1,” plus a remainder that satisfies 


ma =o. 
x0 |x|"~' 

Each of the inner sums extends over all ordered k-tuples (/,,..., 4), as in 
part (a); as usual, the zero-order derivative of f is simply f, so that the constant 
term of the Taylor polynomial of f at a is f(a). 

(c) Exercise 29 shows that repetition occurs in the Taylor polynomial as written in 
part (6). For instance, D,,3; occurs three times, as D,:3, Di3:, D3;1. The sum of 
the corresponding three terms can be written in the form 


3(.D? D3 f (a)x? Exe). 


Prove (by calculating how often each derivative occurs) that the Taylor polynomial 
in (6) can be written in the form 


(Di! ++» Dit f(a) _,, - 
"aa i) Gras 


Sq)? ase! 


z 


Here the summation extends over all ordered n-tuples (s,,.... 5,) such that each 
$, IS a NONNegative integer, and s, + -::+s5,<m—1. 
Suppose fe @‘* in some neighborhood of a point a € R?, the gradient of / is 0 
at a, but not all second-order derivatives of f are 0 at a. Show how one can then 
determine from the Taylor polynomial of f at a (of degree 2) whether / has a local 
maximum, or a local minimum, or neither, at the point a. 

Extend this to R" in place of R?. 


10 


INTEGRATION OF DIFFERENTIAL FORMS 


Integration can be studied on many levels. In Chap. 6, the theory was developed 
for reasonably well-behaved functions on subintervals of the real line. In 
Chap. I1 we shall encounter a very highly developed theory of integration that 
can be applied to much larger classes of functions, whose domains are more 
or less arbitrary sets, not necessarily subsets of R". The present chapter is 
devoted to those aspects of integration theory that are closely related to the 
geometry of euclidean spaces, such as the change of variables formula, line 
integrals, and the machinery of differential forms that is used in the statement 
and proof of the n-dimensional analogue of the fundamental theorem of calculus, 
namely Stokes’ theorem. 


INTEGRATION 


10.1 Definition Suppose J‘ is a k-cell in R*, consisting of all 


a X,) 
such that 
(1) 42%,66, G=1,...,k), 
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I‘ is the j-cell in R’ defined by the first j inequalities (1), and f is a real con- 
tinuous function on J". 
Put f = f,, and define f,_, on I*~' by 


by 
aCe a Me ee 
aK 


The uniform continuity of f, on /* shows that f,_, is continuous on /*~'. 
Hence we can repeat this process and obtain functions /;, continuous on I’, such 
that f;_, is the integral of /;, with respect to x;, over [a;, b;]. After A steps we 
arrive at a number f,, which we call the integral of f over I“; we write it in the 
form 


(2) [ foodx or | f 


A priori, this definition of the integral depends on the order in which the 
k integrations are carried out. However, this dependence is only apparent. To 
prove this, let us introduce the temporary notation L(f) for the integral (2) 
and L'(f) for the result obtained by carrying out the A integrations in some 
other order. 


10.2 Theorem For every fe G(I"), L(f) =L'(f). 


Proof If A(x) = /,(x,) °° > Ay(x,), where A, € €([a;, 5,)), then 


aj, J 
L(h) = I { “he dx, = L'(h). 


If of is the set of all finite sums of such functions /, it follows that L(g) = 
L(g) for all g € #. Also, is an algebra of functions on /* to which the 
Stone-Weierstrass theorem applies. 


k 
Put V=][ (6; —a;). If fe 6) and «> 0, there exists g € & such 
1 


that || f—gl| < e/V, where ||f\| is defined as max |f(x)| (xeJ/*). Then 
[Lif — 9)| < 6, |L'f—g)| < «, and since 


Lf) - Lif) =f -g) + Lig —S), 


we conclude that |L(/) — L'(f)| < 2e. 
In this connection, Exercise 2 is relevant. 


10.3 Definition The support of a (real or complex) function f on R* is the 
closure of the set of all points x € R* at which f(x) #0. If fis a continuous 
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function with compact support, let /“ be any k-cell which contains the support 
of f, and define 


(3) LfefF 


The integral so defined is evidently independent of the choice of J/*, provided 
only that /* contains the support of f. 

It is now tempting to extend the definition of the integral over R* to 
functions which are limits (in some sense) of continuous functions with compact 
support. We do not want to discuss the conditions under which this can be 
done: the proper setting for this question is the Lebesgue integral. We shall 
merely describe one very simple example which will be used in the proof of 
Stokes’ theorem. 


10.4 Example Let Q* be the k-simplex which consists of all points x = 
@ins., &) mR Yor whieh; + °° + %,a1 and x,>0 fori=1,..., k. if 
k = 3, for example, Q* is a tetrahedron, with vertices at 0,e,,e,,e,. Iffe €(0"), 
extend f to a function on J“ by setting f(x) = 0 off Q*, and define 


(4) Lau 


Here /* is the ‘unit cube’’ defined by 
p92e1 (=i =®). 


Since f may be discontinuous on /*, the existence of the integral on the 
right of (4) needs proof. We also wish to show that this integral is independent 
of the order in which the k single integrations are carried out. 

To do this, suppose 0 < 6 < |, put 


(! (t< 1-6) 
]-1t 
(3) Q(t) = ( ; u-6 anal) 
‘0 Gle<ot), 
and define 
(6) F(x) = 9(x, +77 + x)S(x) (x eT"). 
Then Fe G(1"). 
Pt ¥ =H (Kp. nw - \e-1)) X =(y, x,). For each yeJ‘~', the set of all x, 


such that Fly, x,) # f(y; x,) is either empty or is a segment whose length does 
not exceed 6. Since 0 < ~ < 1, it follows that 


(7) | Fu-aly) —f-a(y)| < SIfl = (ye r*~”), 
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where |/f|| has the same meaning as in the proof of Theorem 10.2, and F,_,, 
J,-, are as in Definition 10.1. 
As 6 > 0, (7) exhibits f,_, as a uniform limit of a sequence of continuous 
functions. Thus f,_,; € @(/*~'), and the further integrations present no problem. 
This proves the existence of the integral (4). Moreover, (7) shows that 


(8) | P F(x) dx — J, f(x) dx| < dif. 


Note that (8) is true, regardless of the order in which the & single integrations 
are carried out. Since Fe 6(/*), {F is unaffected by any change in this order. 
Hence (8) shows that the same is true of [f. 

This completes the proof. 

Our next goal is the change of variables formula stated in Theorem 10.9. 
To facilitate its proof, we first discuss so-called primitive mappings, and parti- 
tions of unity. Primitive mappings will enable us to get a clearer picture of the 
local action of a 6’-mapping with invertible derivative, and partitions of unity 
are a very useful device that makes it possible to use local information in a 
global setting. 


PRIMITIVE MAPPINGS 


10.5 Definition If G maps an open set Ec R" into R", and if there is an 
integer and a real function g with domain E such that 


(9) G(x) = Y xe +9~0e, (xe E), 


then we call G primitive. A primitive mapping is thus one that changes at most 
one coordinate. Note that (9) can also be written in the form 


(10) G(x) = x + [9(x) — Xnlen- 


If g is differentiable at some point ae E, so is G. The matrix [x,,] of the 
operator G'(a) has 


(11) (D,9)(a), ---» (Dm g(a), - ++, (Dn ga) 


as its mth row. For j/ #m, we have a,;;= 1 and a,,=0 if i#j. The Jacobian 
of G at ais thus given by 


(12) J¢(a) = det[G(a)] = (D,, 9)(a), 
and we see (by Theorem 9.36) that G’(a) is invertible if and only if (D, g(a) # 9. 
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10.6 Definition A linear operator B on R" that interchanges some pair of 
members of the standard basis and leaves the others fixed will be called a flip. 
For example, the flip B on R* that interchanges e, and e, has the form 


(13) BO, e@; + Key + Vey + Xpeg) =X, eC, + Noreg + VY He, + NZ e, 
or, equivalently, 
(14) B(x, e,; + x, e, + x30; + X44) = ¥,e, + Vye, + ¥3e; + x, €,. 


Hence B can also be thought of as nit hanging two of the coordinates, rather 
than two basis vectors. 

In the proof that follows, we shall use the projections Py, ..., P, in R", 
defined by Py x = 0 and 


(15) jeanne +--+ ae 


for 1<m<n. Thus P,, is the projection whose range and null space are 
spannedlby fe ,,..°, @,,) endele,,, ». .... ¢,). respectively, 


10.7 Theorem Suppose F is a @'-mapping of an open set E < R" into R", Ve E, 
F(0) = 0, and F'(9) is invertible. 
Then there is a neighborhood of 0 in R" in which a representation 


(16) F(x) = B, = BG, @ > eG (x) 


is valid. 
In (16), each G; is a primitive G'-mapping in some neighborhood of 9; 
G,(0) = 0, G,(0) is invertible, and each B, is either a flip or the identity operator. 


Briefly, (16) represents F locally as a composition of primitive mappings 
and flips. 


Proof Put F=F,. Assume 1 <1<n-—1, and make the following 
induction hypothesis (which evidently holds for m = 1): 
V,, is a neighborhood of 0, F,,€@'(V,,,) E,,(0) = 9, F; 


(0) is invertible, 


mt 


and 
(17) Foes Fp aa am x (x € Vx): 
By (17), we have 


(18) F,,(x) = Py 1x + 3. x(xe;, 


t=m 


where @,,,--., &, are real G’-functions in V,,. Hence 


(I 9) F,,(O)e,, = 2d ( Dis Xj )( O)e; : 
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Since F’(0) is invertible, the left side of (19) is not 0, and therefore there 
is a k such that m < k <n and (D,,a,)(0) # 0. 

Let B,, be the flip that interchanges m and this k (if k = m, B,, is the 
identity) and define 


(20) G,,(x) = = [o,(x) = Keats (x E Ven): 


Then G,,c @’'(V,,), G,, iS primitive, and G/ (0) is invertible, since 
(D,, %)(0) 4 9. 
The inverse function theorem shows therefore that there is an open 
set U,,, with Oe U,, < V,,, such that G,, is a 1-1 mapping of U,, onto a 
neighborhood V,,,, of 0, in which G,;’ is continuously differentiable. 
Define*F,,,., by 
(21) Fret 19) = Ba Fin Gas &) (ye Vemma) 
Then F,.4; €@'(Vne1), Fn+1(0) = 0, and F,,,,(0) is invertible (by 
the chain rule). Also, for x € U,,, 
(22) Py a i(G,,(x)) —_ ait Bn F,,(X) 
= =| ae it Oy (XC ny x ‘] 
=P,,-1X te 4 (XC, 
= Py GalX) 
so that 


(23) Pa F es (Y) a Pay (y E V ua). 


Our induction hypothesis holds therefore with m + 1 in place of m. 

[In (22), we first used (21), then (18) and the definition of B,,, then 
the definition of P,,, and finally (20).] 

Since B,, B,, = 1, (21), with y = G,,(x), is equivalent to 


(24) F2@) = Ba Foes (Galx)) (xe U,,). 
If we apply this with m= 1, ...,n —1, we successively obtain 
F=F, = BF, °oG, 
= B,B,F,°G,°G,=::: 
= Bie abe G@equa > G, 


in some neighborhood of 0. By (17), F, is primitive. This completes the 
proof. . 
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PARTITGIONS OF UNITY 


10.8 Theorem Suppose K is a compact subset of R", and {V ,} is an open cover 
of K. Then there exist functions ,, ..., ¥,€ G(R") such that 


(a) O<y,;<lforl<is<s; 
(b) each W; has its support in some V,, and 
(c) W(x) + +++ + W(x) = 1 for every xe K. 


Because of (c), {w;} is called a partition of unity, and (b) is sometimes 
expressed by saying that {w,} 1s subordinate to the cover {V,}. 


Corollary Jf fe G(R") and the support of f lies in K, then 


(25) f= Y wil 


i= 
Each wf has its support in some V,. 


The point of (25) is that it furnishes a representation of f as a sum of 
continuous functions w;/f with ‘“‘small’’ supports. 


Proof Associate with each xe K an index +(x) so that xe V,,,. Then 
there are open balls B(x) and W(x), centered at x, with 


(26) B(x) ¢ W(x) ¢ W(x) C Vary) 
Since K is compact, there are points x,,..., x, in K such that 
(27) Kc B(x,) U +: U B(Xx,). 
By (26), there are functions g,, ..., y,€‘6(R"), such that yx) = 1 on 
B(x;), p(X) = 0 outside W(x;), and 0 < g(x) < | on R". Detine py, = ¢, 
and 
(28) Wien =U —@) °° CU — odeiss 
fon? 1... s- 20 
Properties (a) and (4) are clear. The relation 
(29) Se oS (1 gy) (1 - ©) 


is trivial for i= 1. If (29) holds for some i < s, addition of (28) and (29) 
yields (29) with i + 1 in place of 7. It follows that 


6°) YL vieo =1- if [1— g(x] (xe R"). 


if xe K, then x € B(x;) for some i, hence v(x) = 1, and the product in 
(30) is 0. This proves (c). 
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CHANGE OF VARIABLES 


We can now describe the effect of a change of variables on a multiple integral. 
For simplicity, we'confine ourselves here to continuous functions with compact 
support, although this is too restrictive for many applications. This is illustrated 
by Exereises 9 to 13: 


10.9 Theorem Suppose T is a 1-1 €'-mapping of an open set Ec R* into R* 
such that J,(x) # 0 forallxe E. If fis a continuous function on R* whose support 
is compact and lies in T(E), then 


(31) [_fody = f(T 00)|Jr00] dx. 


We recall that J; is the Jacobian of 7. The assumption J,(x) 4 0 implies, 
by the inverse function theorem, that T~' is continuous on 7(E), and’ this 
ensures that the integrand on the right of (31) has compact support in E 
(Theorem 4.14). 

The appearance of the absolute value of J;(x) in (31) may call for a com- 
ment. Take the case k = 1, and suppose 7 is a 1-1 @'-mapping of R' onto R'. 
Then J;(x) = T(x); and if T is increasing, we have 


(32) [fora = fo ST ONTO de, 


by Theorems 6.19 and 6.17, for all continuous / with compact support. But if 
T decreases, then T'(x) <0; and if f is positive in the interior of its support, 
the left side of (32) is positive and the right side is negative. A correct equation 
is obtained if T’ is replaced by |7’| in (32). 

The point is that the integrals we are now considering are integrals of 
functions over subsets ‘of R*, and we associate no direction or orientation with 
these subsets. We shall adopt a different point of view when we come to inte- 
gration of differential forms over surfaces. 


Proof It follows from the remarks just made that (31) is true if T is a 
primitive @'-mapping (see Definition 10.5), and Theorem 10.2 shows 
that (31) is true if 7 is a linear mapping which merely interchanges two 
coordinates. 

If the theorem is trve for transformations P, Q, and if S(x) = P(Q(x)), 
then 


[/@ dz = | FPO) |Joly)| ay 
= | SP(QG))|Je(OCO)] |Jo()| dx 
= | (SO) |Js0)| ax, 
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since 
J p( O(x))Jo(x) = det P’(Q(x)) det O'(x) 
= dt P'(O(4)) O' @&) = det S(&) = Jelk). 


by the multiplication theorem for determinants and the chain rule. Thus 
the theorem is also true for S. 
Each point aeé E has a neighborhood U c EF in which 


(33) TKK) = The) 8, ---p.(G, Gyo 6, —a), 


where G; and B; are as in Theorem 10.7. Setting V = 7(L’), it follows 
that (31) holds if the support of f lies in V. Thus: 

Each point y € T(E) lies in an open set Vy < T(E) such that (31) holds 
for all continuous functions whose support lies in V,. 

Now let / be a continuous function with compact support K c 7(E£). 
Since {V,} covers K, the Corollary to Theorem 10.8 shows that f= ZW; f, 
where each y; is continuous, and each yw; has its support in some Vy. 
Thus (31) holds for each wy; /, and hence also for their sum /. 


DIFFERENTIAL FORMS 


We shall now develop some of the machinery that is needed for the -dimen- 
sional version of the fundamental theorem of calculus which is usually called 
Stokes’ theorem. The original form of Stokes’ theorem arose in applications of 
vector analysis to electromagnetism and was stated in terms of the curl of a 
vector field. Green's theorem and the divergence theorem are other special 
cases. These topics are briefly discussed at the end of the chapter. 

It is a curious feature of Stokes’ theorem that the only thing that is difficult 
about it is the elaborate structure of definitions that are needed for its statement. 
These definitions concern differential forms, their derivatives, boundaries, and 
Orientation. Once these concepts are understood, the statement of the theorem 
is very brief and succinct, and its proof presents little difficulty. 

Up to now we have considered derivatives of functions of several variables 
only for functions defined in open sets. This was done to avoid difficulties that 
can occur at boundary points. It will now be convenient, however, to discuss 
differentiable functions on compact sets. We therefore adopt the following 
convention: 

To say that f is a @’-mapping (or a 6"-mapping) of a compact set 
D c R* into R" means that there is a 6’-mapping (or a @"-mapping) g of 
an open set Wc R* into R" such that Dc W and such that g(x) = f(x) for 
all xe D. 
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10.10 Definition Suppose E is an open set in R". A k-surface in E is a @’- 
mapping ® from a compact set D c R* into E. 

D is called the paramerer domain of ©. Points of D will be denoted by 
l= ...5 

We shall confine ourselves to the simple situation in which D its either a 
k-cell or the k-simplex O* described in Example 10.4. The reason for this is 
that we shall have to integrate over D, and we have not yet discussed integration 
over more complicated subsets of R*. It will be seen that this restriction on D 
(which will be tacitly made from now on) entails no significant loss of generality 
in the resulting theory of differential forms. 

We stress that k-surfaces in E are defined to be mappings into E, not 
subsets of E. This agrees with our earlier definition of curves (Definition 6.26). 
In fact, 1-surfaces are precisely the same as continuously differentiable curves. 


10.11 Definition Suppose E is an open set in R”. A differential form of order 
k > 1 in E (briefly, a k-form in E) is a function w, symbolically represented by 
the sum 


(34) oO= Y a, OG, AP Se IN ax, 
(the indices i,, ..., i, range independently from | to 1), which assigns to each 
k-surface ® in E a number o(®) = fg w, according to the rule 
. Se? 
1) o= i, °° ,,(@(u)) ——— du, 
\, Px »(PCu)) | 7 


where D is the parameter domain of ®. 
The functions a;,... ;, are assumed to be real and continuous in F. If 


f;, ---, f, are the components of ®, the Jacobian in (35) is the one determined 
by the mapping 


(tly. .<. sadder (¢;,(u), ..., ;,(u)). 


Note that the right side of (35) is an integral over D, as defined in Defini- 
tion 10.1 (or Example 10.4) and that (35) is the definition of the symbol |g w. 

A k-form @ is said to be of class @’ or 6” if the functions a;, ... ;, in (34) 
are all of class @’ or @”’. 


A 0-form in E is defined to be a continuous function in E. 


10.12 Examples 


(a) Let y be a I-surface (a curve of class @’) in R*, with parameter 
domain [0, 1]. 


Write (x, y, z) in place of (x,, x, x3), and put 


w=xdy+ydx. 


(36) 
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Then 
| w= I, [yi()yo(t) + ot )yi(t)] dt = y,C1)y2(1) — y,(0)y2(0). 


Note that in this example J, @ depends only on the initial point y(0) 
and on the end point y(l) of y. In particular, i, w = 0 for every closed 
curve 7. (As we shall see later, this is true for every |!-form q@ which is 
exact.) 

Integrals of l-forms are often called /ine integrals. 

(b) Fix a>0, b> 0, and define 


y(t) = (a cos t, b sin tr) (O<1< 2n), 


so that y is a closed curve in R*. (Its range is an ellipse.) Then 


[x dy = fab cos? t dt = rab, 


y 


whereas 
2n 
[ yav = -{ ab sin? t dt = —nab. 
7 0 


Note that f, x dy is the area of the region bounded by y. This is a 
special case of Green’s theorem. 
(c) Let D be the 3-cell defined by 


=r < !l. O<0<n, O<g<_2n. 
Deine, 0;.~) = (x, h. 2. Where 


x= resin cés © 
y=rsin6sino 


z=rcos 9. 
Then 
Jolr, 9, p) = wars =r? sin 0. 
Hence 
i dx A dy x dz = | | ars 
. D 3 


Note that ® maps D onto the closed unit ball of R®, that the mapping 
is 1-1 in the interior of D (but certain boundary points are identified by 
®), and that the integral (36) is equal to the voiume of ®(D). 
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10.13 Elementary properties Let w, w,, w, be k-forms in E. We write w, = w, 
if and only if w,(®) = w,(®) for every k-surface ® in E. In particular, o = 0 
means that w(®) = 0 for every k-surface ® in E£. If c is a real number, then 
cw is the k-form defined by 


(37) fs cw=c ik w, 
and w = w, + w, means that 
(38) i" oe jo + [02 


for every k-surface ® in E. As a special case of (37), note that —w is defined so 
that 


39 —w)= — dw. 
(39) [(-o= =f. 
Consider a k-form 


(40) w =a(x)dx;,A °°: A dN, 


and let © be the A-form obtained by interchanging some pair of subscripts in 
(40). If (35) and (39) are combined with the fact that a determinant changes 
sign if two of its rows are interchanged, we see that 


(41) @ = —w. 
As a special case of this, note that the anticommutative relation 
(42) dx; A dx, = —dx, n dx; 
holds for all i and /. In particular, 
(43) aX, Ade, =O | 2 


More generally, let us return to (40), and assume that j, = i, for some 
r#s. If these two subscripts are interchanged, then @ = w, hence w = 0, by 
(41). 

In other words, if w is given by: (40), then w=0 unless the subscripts 
iy. eee, are all distinct. 

If w is as in (34), the summands with repeated subscripts can therefore 
be omitted without changing w. 

It follows that 0 is the only k-form in any open subset of R", if k > xn. 

The anticommutativity expressed by (42) is the reason for the inordinate 
amount of attention that has to be paid to minus signs when studying differential 
forms. 
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10.14 Basic k-forms If j,, .... i, are integers such that | <i, <i, < °°: 
< i, <n, and if / is the ordered k-tuple {/,...., 4}, then we call / an increasing 
k-index, and we use the brief notation 


(44) dx, = dx, N °°: A dN; 


tp? 


These forms dx, are the so-called basic k-forms in R". 

It is not hard to verify that there are precisely n'!/k'(n — k)! basic k-forms 
in R": we shall make no use of this, however. 

Much more important is the fact that every k-form can be represented in 
terms of basic k-forms. To see this, note that every k-tuple (/,...., /,} of distinct 
integers can be converted to an increasing k-index J by a finite number of inter- 
changes of pairs; each of these amounts to a multiplication by —1, as we saw 
im Sec. 10.13; hence 


(45) big RAE), ZAjy. cox iy) dx, 

where é(j,.....4,) is | or —I. depending on the number of interchanges that 
are needed. In fact, it is easy to see that 

(46) Ay... «POM, 2°... 4 


where s is as in Delinition 9.33. 
For example. 


Gi, A dX g AGM, ROS = —de, A dx, K dx, A dx, 
and 
dx, Wed, * dNy= dxyn dx Peds, . 


If every k-tuple in (34) is converted to an increasing k-index, then we 
obtain the so-called standard presentation of w: 


(47) @= > DA) dx,. 

if 
The summation in (47) extends over all increasing k-indices /. [Of course, every 
increasing k-index arises from many (from k!, to be precise) A-tuples. Each 


b, in (47) may thus be a sum of several of the coefficients that occur in (34).] 
For example, 


Ny ANN dx, > Nilay A dNoe Xz dx, NdN, redn, A dN; 
is a 2-form in R° whose standard presentation is 
(ieee, ree, Ae Ft ee, FT, Wy. 


The following uniqueness theorem is one of the main reasons for the 
introduction of the standard presentation of a 4-form. 
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10.15 Theorem Suppose 
(48) = ) d(x) dx, 
if 


is the standard presentation of a k-form @ in an open set Ec R". Ifw =0 in E, 
then b,(x) = 0 for every increasing k-index I and for every x € E. 

Note that the analogous statement would be false for sums such as (34), 
since, for example, 


dx, N-dx, + dx, ndx, =0. 


Proof Assume, to reach a contradiction, that 5,(v) > 0 for some ve E 
and for some increasing k-index J = {j,,....,}. Since 4, is continuous, 
there exists /) > 0 such that b,(x) >0 for all x € R” whose coordinates 
satisfy |x,;—10;| <A. Let D be the k-cell in R* such that ue D if and 
only. if |v,.| <2 forr=1,..., k. Define 


k 
(49) Ou)=v+)u,e, (ue D). 
r=1 


Then ® is a k-surface in E, with parameter domain D, and b,(®(u)) > 0 
for every ue D. 
We claim that 


(50) I, ex I, b,((u)) du. 


Since the right side of (50) is positive, it follows that w(®) 4 0. Hence 
(50) gives our contradiction. 

To prove (50), apply (35) to the presentation (48). More specifically, 
compute the Jacobians that occur in (35). By (49), 


ee 
Gy, . . tg) 


For any other increasing 4-index I # J, the Jacobian is 0, since it is the 
determinant of a matrix with at least one row of zeros. 


10.16 Products of basic k-forms Suppose 
(51) i ee SP D8 fee. da 


wheel <a =:--. <4 em@eand | ay <a--- <j, <n. The product of the cor- 
responding basic forms dx, and dx, in R" is a(p +q)-form in R", denoted by 
the symbol dx, A dx,. and defined by 


(52) Ny ROEN y SON ROM RONG, Py dx; - 
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if J and J have an element in common, then the discussion in Sec. 10.13 
shows that dx, A dx, = 0. 

If and J have no element in common, let us write [/, J] for the increasing 
(p + q)-index which is obtained by arranging the members of J U J in increasing 
order. Then dx;, 4) 1s a basic (p + g)-form. We claim that 


(53) dx, N dx, =(—1) dxpy, yj 


where x is the number of differences /, — i, that are negative. (The number of 
positive differences is thus pq — a.) 
To prove (53), perform the following operations on the numbers 


(54) a ae 


Move i, to the right, step by step, until its left neighbor is less than i,. The 
number of steps is the number of subscripts ¢ such that /, </,. (Note that 0 
steps are a distinct possibility.) Then do the same for /,_,,...,i,. The total 
number of steps taken is x. The final arrangement reached is [J/, /]. Each step, 
when applied to the right side of (52), multiplies dx, A dx, by —1. Hence (53) 
holds. 

Note that the right side of (53) is the standard presentation of dx, A dx,. 


Next, let K = (k,,..., k,) be an increasing r-index in {1,..., m}. We shall 
use (53) to prove that 
(35) (dx; A dx,;) Nn. dxy = dx, a (dx; A dx;,). 


If any two of the sets J, J, K have an element in common, then each side 
of (55) is 0, hence they are equal. 

So let us assume that J, J, K are pairwise disjoint. Let [/, J, K] denote 
the increasing (p + q + r)-index obtained from their union. Associate B with 
the ordered pair (J, K) and y with the ordered pair (J, K) in the way that a was 
associated with (/, J) in (53). The left side of (55) is then 

Se Axe, 4 A dx, = (—1)*%( - i AXe1, 3, K} 
by two applications of (53), and the right side of (55) is 
(—1)? dx, a AXty, x) = (=1)%(-1)**” AX, 5, K}- 


Hence (55) is correct. 


10.17 Multiplication Suppose w and 1 are p- and q-forms, respectively, in 
some open set E < R", with standard presentations 


(56) @ = % bGlws,,. A= D c (x) dx, 


where J and J range over all increasing p-indices and over all increasing q-indices 
taken from the set {1,..., 7}. 


260 PRINCIPLES OF MATHEMATICAL ANALYSIS 


Their product, denoted by the symbol w a A, is defined to be 
(57) wAA= > b,(x)cj(x) dx, A dx,. 
J 
In this sum, Jand J range independently over their possible values, and dx, A dx, 
is as in Sec. 10.16. Thus wm A dis a(p+q)-form in E. 


It is quite easy to see (we leave the details as an exercise) that the distribu- 
tive laws 


(@, + 2) AA =(@, AAD + (@, A A) 
and 
wa (A, + 42) =(@ A 4,) + (WA Az) 


hold, with respect to the addition defined in Sec. 10.13. If these distributive 
laws are combined with (55), we obtain the associative law 


(58) (wAA)AT=WA(AAQ) 


for arbitrary forms @, A, a in E. 
In this discussion it was tacitly assumed that p > | andg > 1. The product 
of a 0-form / with the p-form w given by (56) is simply defined to be the p-form 


fo = wf = mi (x)b,(x) 4... 


It is customary to write fw, rather than f A w, when / is a 0-form. 


10.18 Differentiation We shall now define a differentiation operator d which 


associates a (k + 1)-form dw to each k-form w of class @’ in some open set 
Ee rR 
A 0-form of class @’ in E is just a real function fe @’(E), and we define 


(59) df = ¥ (DLV) dx, 


If w = £b,(x) dx, is the standard presentation of a k-form w, and b,;€ @'(E) 
for each increasing k-index J, then we define 


(60) dw = ¥. (db;) A dx. 
I 


10.19 Example Suppose E is open in R", fe @(E), and y is a continuously 
differentiable curve in E, with domain [0, 1]. By (59) and (35), 


agkt Un 
(61) [f=] Y WNW) at. 
-y QO i=1 
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By the chain rule, the last integrand is (f¢ y)‘(t). Hence 


(62) [ a= SOQ) - fo), 


and we see that {i df is the same for all y with the same initial point and the same 
end point, as in (a) of Example 10.12. 

Comparison with Example !0.12(6) shows therefore that the |-form x dy 
is not the derivative of any 0-form /, This could also be deduced from part (b) 
of the following theorem, since 


d(x dy) = dx n dy #0. 


10.20 Theorem 


(a) If w and i are k- and m-forms, respectively, of class €' in E, then 
(63) d(w a 4) = (dw) NA +(-1)' wa di. 
(b) Ifw is of class 6" in E, then d*w = 0. 
Here d*w means, of course, d(dw). 


Proof Because of (57) and (60), (a) follows if (63) is proved for the 
special case 


(64) W@W =f Bitz, A = g dx, 


where f, g€ @(E), dx, is a basic k-form, and dx, is a basic m-form. [If 
k or m or both are 0, simply omit dx, or dx, in (64); the proof that follows 
is unaffected by this.] Then 


wAA=fgdx, A dx,. 


Let us assume that J and J have no element in common. [In the other 
case each of the three terms in (63) is 0.] Then, using (53), 


d(w a A) = d(fg dx,  dxj) =(—1)" d(fg ax,;, 3). 
By (59), d(fg) = fdg +g df. Hence (60) gives 


d(w a A)=(—1)" (fdg +9 df) 0 ax yy 
=(gidft fda) dx, n.dx,.. 


Since dg is a |-form and dx, is a k-form, we have 


dg n dx, =(—1)* dx, a dg, 
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by (42). Hence 
d(w n a) = (df 0 dx 1) 0 (g dxy) + (— If dx) 0 (dg A dx,) 
= (dw) a A+(—1)'w a da, 
which proves (a). 


Note that the associative law (58) was used freely. 
Let us prove (b) first for a 0-form fe @": 


at fe a( ¥ (Dix) ax, 
= y d(D,f) n dx; 


i y (Df )(x) dx; A dx;. 
i, j=1 


Since D,,f = D,,f (Theorem 9.41) and dx; A dx, = —dx, A dx;, we see 
that d?f = 0. 

If w = fdx,, as in (64), then dw = (df) a dx,. By (60), d(dx,) = 0. 
Hence (63) shows that 


d’w = (d*f) a dx, =0. 
10.21 Change of variables Suppose E is an open set in R", 7 is a @’-mapping 
of E into an open set V c R”, and w is a k-form in V, whose standard presenta- 
tion is 
(65) o= » by) dy;. 


(We use y for points of V, x for points of E.) 
Let t,, ..., t,, be the components of T: If 


Y=(Or1,.--- + Ym) = T(x) 
then y; = #,(x). As in (59), 
(66) dt, = > (D,t))(x) dx; (i i =). 
j=1 
Thus each dt; is a 1-form in E. 
The mapping 7 transforms @ into a k-form w; in E, whose definition is 

(67) Wy = ) bAT(x)) dt;,, A ++: A dt;,. 

7 
In each summand of (67), J = {i,, ..., i,} is an increasing k-index. 


Our next theorem shows that addition, multiplication, and differentiation 
of forms are defined in such a way that they commute with changes of variables. 
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10.22 Theorem With E and T as in Sec. 10.21, let w and 4 be k- and m-forms 
in V, respectively. Then 


(68) 


(69) 


(70) 


(a) (w+ A)p = wy t+ Az ifk =m; 
(6) (WA A)p = wr A Az; 
(c) d(wy) = (dw); if w is of class €’ and T is of class @". 


Proof Part (a) follows immediately from the definitions. Part (b) is 
almost as obvious, once we realize that 


(dy;, A *°: Ady, )p =dt;,, A **: Adt 


regardless of whether {i,,..., 7,} iS increasing or not; (68) holds because 
the same number of minus signs are needed on each side of (68) to produce 
increasing rearrangements. 

We turn to the proof of (c). If fis a 0-form of class @’ in V, then 


frx) =f(T(x), df= 2 (DS My) dy;. 
By the chain rule, it foilows that 
d(fr) = d (Dif) dx; 
= a d (DST O)D; tix) dx; 


=) (DST (x) at; 


= (df);. 
If dy; =dy;, A °:: A dy;,,, then (dy,); =dt;, \ °'* A dt;,, and Theorem 
10.20 shows that 
d((dy ;)r) = 0. 


(This is where the assumption 7 € @” is used.) 
Assume now that wm =fdy,. Then 


Wr = fr(x) (dy )r 


and the preceding calculations lead to 


d(wr) = d( fr) 0 (dy) = (df )r A (Dd 
= ((df) 0 dy;)7 = (dw);. 
The first equality holds by (63) and (70), the second by (69), the third by 
part (b), and the last by the definition of dw. 


The general case of (c) follows from the special case just proved, if 
we apply (a). This completes the proof. 
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Our next objective is Theorem 10.25. This will follow directly from two 
other important transformation properties of differential forms, which we state 
first. 


10.23 Theorem Suppose T is a @'-mapping of an open set E < R" into an open 
set Vc R™, S is a G'-mapping of V into an open set W & R?, and w is a k-form 
in W, so that ws is a k-form in V and both (ws) and wsry are k-forms in E, where 
ST is defined by (ST )(x) = S(T(x)). Then 
(71) (Ws)7 = Wsr. 

Proof If @ and A are forms in W, Theorem 10.22 shows that 

((@ A A)s)r = (Ws A As)r = (Ws)r A (As)r 
and 
(@ A A)sp = Wsz A Agr. 


Thus if (71) holds for w and for A, it follows that (71) also holds for w A A. 
Since every form can be built up from 0-forms and |-forms by addition 
and multiplication, and since (71) is trivial for 0-forms, it is enough to 
prove (71) in the case w=dz,,q=1,..., p. (We denote the points of 
E, V, W by x, y, z, respectively.) 

Let f,, ..., tj, be the components of 7, let 5,, ..., s, be the compo- 
nents of S, and let r;, ..., r, be the components of ST. If w = dz,, then 


Ws = ds, = d (D,s,)(y) 4y,, 
so that the chain rule implies 
(Ws)r = 2 (Dj 5q)(T (x)) dt, 
= d (Dj 54)(T (x)) 2 (Dj t;)(x) dx, 


= FL (DirgXx) dy = dry = Ws. 


10.24 Theorem Suppose w is a k-form in an open set E < R", ® is a k-surface 
in E, with parameter domain D < R*, and A is the k-surface in R*, with parameter 
domain D, defined by A(u) = u(ue D). Then 


[lo= Io 


Proof We need only consider the case 


w = a(x) dx;, A*** A dx,. 
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If @,, ..., d, are the components of ®, then 
We = a(P(u)) dp;, A °°: A db 


Hic 


The theorem will follow if we can show that 


(72) dp, \ °° 4 do, = I@)du, ra --- a du,, 
where 
J(u) = OOK iy + Hird ' 
Cily,.. » «golly 


since (72) implies 
ow { a(®(u))J(u) du 
® D 
= [ a(@(u))J(u) du, A A dy = { by. 
es A 


Let [A] be the & by k matrix with entries 


x(p.q)=(D,6;,u) (p,q =1,..., 4). 
Then 
do;, = 3 (p,q) du, 
so that 
Gi ah nadie FY ag y: -~aldenggudu,, A --° Andy, . 
In this last sum, q,, ..., q, range independently over 1, ..., k. The anti- 
commutative relation (42) implies that 
Gil, IN '** Kili, =WNG,, .uiQy) A, A°°' Avdiuy, 


where s is as in Definition 9.33; applying this definition, we see that 
do;, \ °°: A do; = det [A] du, A«*: A du, ; 
and since J(u) = det [A], (72) is proved. 


The final result of this section combines the two preceding theorems. 


10.25 Theorem Suppose T is a 6'-mapping of an open set E — R" into an open 
set Vc R™, ® is a k-surface in E, and w is a k-form in V. 


Then 
i.” = Jor 
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Proof Let D be the parameter domain of ® (hence also of T®) and 
define A as in Theorem 10.24. 
Then 


f° = F Oro = I. (Wr)o = I, Wr. 


The first of these equalities is Theorem 10.24, applied to T@ in place of ®. 
The second follows from Theorem 10.23. The third is Theorem 10.24, 
with wy in place of w. 


SIMPLEXES AND CHAINS 


10.26 Affine simplexes A mapping f that carries a vector space X into a 
vector space Y is said to be affine if f — £(0) is linear. In other words, the require- 
ment is that 


(73) f(x) = f(0) + Ax 


for some A EL(X, Y). 

An affine mapping of R* into R" is thus determined if we know f(0) and 
f(e;) for 1 < i< k; as usual, {e,, ..., e,} is the standard basis of R*. 

We define the standard simplex Q* to be the set of all ue R* of the form 


k 
(74) u= ss a,e; 
i=1 
such thata,;> 0 fori=1,...,k and Le, < |. 
Assume now that po, p,;, ..., Pp, are points of R". The oriented affine 
k-simplex 
(75) o = [Po. Pi, ---s Px] 


is defined to be the k-surface in R" with parameter domain Q* which is given 
by the affine mapping 


k 
(76) O(a,e, + *** + Oj) = Po + ) a(p; — po). 
i=1 


Note that o is characterized by 


(77) o(0)=po, o(e)=p; (forl <i<hk), 
and that 
(78) o(u) = pp + Au (ue Q*) 


where A € L(R*, R") and Ae; = p; — po for | <i <k. 
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We call o oriented to emphasize that the ordering of the vertices po, ..., py 
is taken into account. If 


(79) 6 =(Pi,- Pi,» os Phe 


where {ip, i,,.... 4} 1S a permutation of the ordered set {0, 1,..., k}, we adopt 
the notation 


(80) © = 6g, fo... ae. 


where sis the function defined in Definition 9.33. Thus ¢ = +o, depending on 
whether s = | or s = —1. Strictly speaking, having adopted (75) and (76) as 
the definition of o, we should not write ¢G =o unless ip = 0, ..., i, =k, even 
If s(ig, .... i.) = 1; what we have here ts an equivalence relation, not an equality. 
However, for our purposes the notation is justified by Theorem 10.27. 

If ¢ = co (using the above convention) and if e = 1, we say that ¢ and o 
have the same orientation: 1f ¢ = —1, 6 and o are said to have opposite orienta- 
tions. Note that we have not defined what we mean by the “orientation of a 
simplex.’ What we have defined is a relation between pairs of simplexes having 
the same set of vertices, the relation being that of “Shaving the same orientation.” 

There is. however, one situation where the orientation of a simplex can 
be detined in a natural way. This happens when n = k and when the vectors 
P; — Po (1 <i <k) are independent. \n that case, the linear transformation A 
that appears in (78) is invertible, and its determinant (which is the same as the 
Jacobian of a) is not 0. Then a is said to be positively (or negative/)) oriented if 
det A is positive (or negative). In particular, the simplex [0,e,,...,e,] in R*, 
given by the identity mapping, has positive orientation. 

So far we have assumed that k>1. An oriented 0-simplex is defined to 
be a point with a sign attached. We write og = +py or d= — py. If o = Epo 
(e = +1) and if fis a 0-form (i.e., a real function), we define 


" S = &f (Po). 


10.27 Theorem I/fo is an oriented rectilinear k-simplex in an open set E — R" 
and if G6 = 0 then 


(81) [o=efo 


for every k-form @ in E. 


Proof For k =0, (81) follows from the preceding definition. So we 
assume k > | and assume that o is given by (75). 
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Suppose | <j<k, and suppose ¢o is obtained from o by inter- 
changing py and p;. Then e = —1, and 


G(u) = p; + Bu (meO"), 


where B is the linear mapping of R* into R" defined by Be; = po — p;, 
Be; = p; — p; if i#j. If we write Ae; =x; (| </<k), where A is given 
by (78), the column vectors of B (that is, the vectors Be;) are 


2 — i... a 


j? —X;, Xj+1 — X;. seey Xp — X;. 


al 
If we subtract the jth column from each of the others, none of the deter- 
minants in (35) are affected, and we obtain columns x,,..., X;-1. —X,, 
Xj+1, ---) X,- These differ from those of 4 only in the sign of the jth 
column. Hence (81) holds for this case. 

Suppose next that 0 <i<j<k and that o is obtained from o by 
interchanging p; and p;. Then a(u) = po + Cu, where C has the same 
columns as A, except that the ‘th and jth columns have been inter- 
changed. This again implies that (81) holds, since e = —1. 

The general case follows, since every permutation of {0, 1, ....k} is 
a composition of the special cases we have just dealt with. 


10.28 Affine chains An affine k-chain T in an open set E <R" is a collection 
of finitely many oriented affine k-simplexes o,,..., 6, in E. These need not be 
distinct; a simplex may thus occur in T with a certain multiplicity. 

If T is as above, and if w is a k-form in E£, we define 


(82) fo=¥ fo. 


We may view a k-surface ® in E as a function whose domain is the collec- 
tion of all k-forms in E and which assigns the number le w to w. Since real- 
valued functions can be added (as in Definition 4.3), this suggests the use of the 
notation 


(83) P=o,+- +0, 


or, more compactly, 
(84) r=) a; 


to state the fact that (82) holds for every k-form @ in E. 

To avoid misunderstanding, we point out explicitly that the notations 
introduced by (83) and (80) have to be handled with care. The point is that 
every oriented affine k-simplex o in R" is a function in two ways, with different 
domains and different ranges, and that therefore two entirely different operations 
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of addition are possible. Originally, o was defined as an R"-valued function 
with domain Q"; accordingly, 0, + 0, could be interpreted to be the function 
o that assigns the vector o,(u) + o,(u) to every uc ON; note that @ is then again 
an oriented affine k-simplex in R"! This is nor what is meant by (83). 

For example, if o, = —o, as in (80) (that is to say, if o, and a, have the 
same set of vertices but are oppositely oriented) and if IT =o, + ¢,, then 
J, w =0 for all w, and we may express this by writing T = 0 or o, + 0, =0. 
This does not mean that o,(u) + 0,(u) is the null vector of R’. 


10.29 Boundaries For k >}, the boundary of the oriented affine k-simplex 
o = [Po. Pi. --- Pal 
is defined to be the affine (k — 1)-chain 


k 
(85) 08 2 LVF in. Bye Byes «++ Bal 
For example, if o = [po. p;, p2], then 
Co = [p,. P2) — (Po. P2) + (Po. Pi] = (Po. Pi) + [P,, P2) + [P2, Po). 


which coincides with the usual notion of the oriented boundary of a triangle. 


For | <j < k. observe that the simplex o, = [po. ..., Pj-1. Pj+i>-- +> Dal 
which occurs in (85) has Q*~' as its parameter domain and that it is detined by 
(86) o(u) = po + Bu (ue OX’). 


where B is the linear mapping from R*~' to R" determined by 
Be; = p; — Po Gf I<i<sj- 1), 
Be; = pi+, — Po (if jsisk-—1). 
The simplex 
Fo = [P;, Pa. ---+ Prd, 
which also occurs in (85), is given by the mapping 
o,(u) = p, + Bu, 


where Be; = p;4; — Pp; forl<si<k- I. 


10.30 Differentiable simplexes and chains Let 7 be a ¢"-mapping of an open 
set E c R" into an open set V c R™; T need not be one-to-one. If ois an oriented 
affine k-simplex in £, then the composite mapping ® = 7» o (which we shall 
sometimes write in the simpler form 7c) is a k-surface in V. with parameter 
domain Q*. We call ® an oriented k-simplex of class 6". 
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A finite collection Y of oriented k-simplexes ®,,....®, of class @” in V 
is called a k-chain of class 6" in V. lf w is a k-form in V, we define 
(87) [o=y | o 
¥ i=1 “Oi 


and use the corresponding notation ‘Y = 2@,. 
If [ = Xo, is an affine chain and if ®; = T>o;, we also write P= TT, 
or 


(88) FO.-o9) = S Bey. 


The boundary 0® of the oriented k-simplex ® = T < a is defined to be the 
(k — 1) chain 


(89) 6 = T (do). 


In justification of (89), observe that if 7 is affine, then ® = 7 <o is an 
oriented affine k-simplex, in which case (89) is not a matter of definition, but is 
seen to be a consequence of (85). Thus (89) generalizes this special case. 

It is immediate that 0® is of class @” if this is true of ®. 

Finally, we define the boundary 0 of the A-chain Y = &@, to be the 
(k — 1) chain 


(90) OY = } 00, 


10.31 Positively oriented boundaries So far we have associated boundaries to 
chains, not to subsets of R". This notion of boundary is exactly the one that ts 
most suitable for the statement and proof of Stokes’ theorem. However, in 
applications, especially in R* or R°, it is customary and convenient to talk 
about “‘oriented boundaries’ of certain sets as well. We shall now describe 
this briefly. 

Let Q” be the standard simplex in R”, let a be the identity mapping with 
domain Q”. As we saw in Sec. 10.26, o) may be regarded as a positively oriented 
n-simplex in R". Its boundary Coo is an affine (m — !)-chain. This chain is 
called the positively oriented boundary of the set Q". 

For example, the positively oriented boundary of Q? is 


[e,, €2, €3] — [0, €2. e3] + [0, e,, e3] — [0, e,, e,]. 


Now let 7 be a !-1 mapping of Q” into R", of class €", whose Jacobian is 
positive (at least in the interior of Q"). Let E = 7(Q"). By the inverse function 
theorem, E is the closure of an open subset of R". We define the positively 
oriented boundary of the set E to be the (nm — 1)-chain 

CT = T (Gem), 
and we may denote this (n — 1)-chain by CE. 
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An obvious question occurs here: If & = 7,(Q") = T,(Q"), and if both 
T, and 7, have positive Jacobians, is it true that °7, = 07T,? That is to say, 
does the equality 
| w= | Ww 
eT, OT 2 


hold for every (n — |)-form w? The answer is yes, but we shall omit the proof. 
(To see an example, compare the end of this section with Exercise 17.) 
One can go further. Let 


= Bw -- w he 


where E; = 7,(Q"), each 7; has the properties that 7 had above, and the interiors 
of the sets £; are pairwise disjoint. Then the (n — 1)-chain 


oT, +--+ OT. = OO 


is called the positively oriented boundary of Q. 
For example, the unit square /? in R? is the union of o,(Q7) and a,(Q7?), 
where 


g,(u) =u, o,(u) =e, +e; —u. 
Both o, and oa, have Jacobian | > 0. Since 
6, = (0. é,.e,], go, ={e, + @,,e,,e,] 
we have 
Co, = [e,, e,] — [0, e,] + [0.e,], 
CGy = [er €y] — fe, + e2.€,] + fe, + e2. €2]; 
The sum of these two boundaries is 
c/* = [0, e,] + [e,,e, + e,] + fe, + e2. e,] + [ep, 0], 
the positively oriented boundary of /*. Note that [e,, e,] canceled [e,, e,]. 
If ® is a 2-surface in R”, with parameter domain /’, then ® (regarded as 
a function on 2-forms) is the same as the 2-chain 
@°o,+D°0,. 
Thus 
oD = o(® o a,) + 0(M oG,2) 
= O(@0,) + ®(40,) = O(0I’). 
In other words, if the parameter domain of ® is the square /*, we need 


not refer back to the simplex Q?, but can obtain @@ directly from 0/?. 
Other examples may be found in Exercises 17 to 19. 
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10.32 Example For 0<u<7,0<v< 2n, define 
L(u, v) = (sin u cos v, Sin wu sin v, COS u). 
Then £ is a 2-surface in R*, whose parameter domain is a rectangle D < R’, 
and whose range is the unit sphere in R®. Its boundary is 
0x = L(OD) = y, + Y2 + V3 + Yo 
where 
y,(u) = X(u, 0) = (sin u, 0, cos u), 
y2(v) = U(x, v) = (0, 0, —1), 
y3(u) = L(x — u, 2n) = (sin u, 0, —cos u), 
ya(v) = LO, 2x — v) = (0, 0, 1), 
with [0, 2] and [0, 27] as parameter intervals for u and ¢, respectively. 
Since y, and y, are constant, their derivatives are 0, hence the integral of 


any l-form over 7, or yg is 0. [See Example 1.12(a).] 
Since y3(u) = y,(z — u), direct application of (35) shows that 


ees 


for every 1-form w. Thus f,; @ = 0, and we conclude that 02 = 0. 

(In geographic terminology, dX starts at the north pole N, runs to the 
south pole S along a meridian, pauses at S, returns to N along the same meridian. 
and finally pauses at VN. The two passages along the meridian are in opposite 
directions. The corresponding two line integrals therefore cancel each other. 
In Exercise 32 there is also one curve which occurs twice in the boundary, but 
without cancellation.) 


STOKES’ THEOREM 


10.33 Theorem Jf 'Y is a k-chain of class €" in an open set V & R" and if w 
is a (k — 1)-form of class G' in V, then 


(91) [do =|. 


The case kK = m = | 1s nothing but the fundamental theorem of calculus 
(with an additional differentiability assumption). The case k = m = 2 is Green’s 
theorem, and k = m = 3 gives the so-called ‘‘divergence theorem’’ of Gauss. 
The case k = 2, m=3 is the one originally discovered by Stokes. (Spivak’s 
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book describes some of the historical background.) These special cases will be 
discussed further at the end of the present chapter. 


(92) 


(93) 


(94) 


(95) 


(96) 


Proof It is enough to prove that 


| dw = { 0) 
® eo 


for every oriented k-simplex ® of class G" in V. For if (92) is proved and 
if ¥ = L®@,. then (87) and (89) imply (91). 
Fix such a ® and put 
G6 = [0, Che — 


Thus oa is the oriented affine k-simplex with parameter domain O* which 
is defined by the identity mapping. Since ® is also defined on Q* (see 
Definition 10.30) and ® € @”, there is an open set E < R* which contains 
Q*, and there is a %”-mapping 7 of E into V such that ®=T<o. By 
Theorems 10.25 and 10.22(c), the left side of (92) is equal to 


[ dw = | (de); = [ d(w 7). 

“io, o nC: 
Another application of Theorem 10.25 shows, by (89), that the right side 
of (92) is 


(v= [ = } 7 . 
“(Ta) * Tieo) Sra 


Since «, is a (kK — 1)-form in E, we see that in order to prove (92) 
we merely have to show that 
faa {i 
o GE 


for the special simplex (93) and for every (k — \)-form + of class ©’ in E. 
If k =1, the definition of an oriented 0-simplex shows that (94) 
merely asserts that 
1 
| £(u) du = (1) — (0) 
"0 
for every continuously differentiable function f on [0.1], which is true 
by the fundamental theorem of calculus. 


From now on we assume that k > 1, fix an integer r (Il <r <k), 
and choose fe %'‘(F). It is then enough to prove (94) for the case 


REGO GY, FR ay ® Um, A °° A GN, 


since every (k — 1)-form is a sum of these special ones, for r= 1, ..., k. 
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By (85), the boundary of the simplex (93) ts 


k 


Go = [e,....,e) + > (-1)'t; 
ra 
where 
be eS [0, Cir p50c Crys Oe; 54) e,] 
forr=1,...,K. ul 
a a a 6. ae. e, | 
Note that t, is obtained from [e,..... e,] by r — | successive interchanges 
of e, and its left neighbors. Thus 
k 
(97) do=(—1)" "t> + > (—I)t,. 
i=a 
Each t; has Q*~' as parameter domain. 
If x = t,(u) and ue O* '. then 
ig (ieee), 
(98) See | | aan eng) =a, 
U;_ (r<y =P 


lf l<is<k, we @~'. and x= tu)othen 


(4 Gl yao). 
(99) x, = \0 wa"). 
ls, (jm j EW). 
ForO0<i<k. let J; be the Jacobian of the mapping 
(100) ee a 


induced by t;. When / = 0 and when / = r, (98) and (99) show that (100) 
is*the identity mapping. Thus J, = 1. /,=!. For other 7, the faet that 
x; = 0 in (99) shows that J; has a row of zeros. hence J; = 0. Thus 


(101) | (0... ey. 
by (35) and (96). Consequently, (97) gives 
(102) a ma 2+ (-1'f 


¢ to 


=(-I'f  f(to() — At w)] du. 


INTEGRATION OF DIFFERENTIAL FORMS 275 


On the other hand, 
OW 2D JM, 2 GX, A MB Nag BK GXizay. A? AAG 
= (1) (Df )(x) dx A + A dx, 


so that 
103 2 =(—1)"' | (D,f)(x) dx. 
(103) [a= (-1" | (D,Ao0 ae 


We evaluate (103) by first integrating with respect to x,, over the interval 
, Wy, et ep tt ey FO RD] 


put (¥,, +. 65 Xp-i) X-+ ne oe Gayo oes Bye) eandsee with theeaid of 
(98) that the integral over Q* in (103) is equal to the integral over O*~! 
in (102). Thus (94) holds, and the proof is complete. 


CLOSED FORMS AND EXACT FORMS 


10.34 Definition Let w be ak-form inan open set E c R". If thereisa(k — 1)- 
form 4 in E such that w = d/, then w is said to be exact in E. 

If wis of class 6’ and dw = 0, then w 1s said to be closed. 

Theorem 10.20(b) shows that every exact form-of class G’ is closed. 

In certain sets E, for example in convex ones, the converse is true; this 
is the content of Theorem 10.39 (usually known as Poincaré’s lemma) and 
Theorem 10.40. However. Examples 10.36 and 10.37 will exhibit closed forms 
that are not exact. 


10.35 Remarks 


(a) Whether a given k-form w is or is not closed can be verified by 
simply differentiating the coefficients in the standard presentation of w. 
For example, a 1-form 


(104) a=) filecdx;, 
i=1 
with f,e @'(E) for some open set Ec R", is closed if and only if the 
equations 
(105) (Df)(X) = (Dif) 


hold for all i, j in {1,..., m} and for all x € E. 
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Note that (105) is a ‘“‘pointwise”’ condition; it does not involve any 
global properties that depend on the shape of E. 

On the other hand, to show that w is exact in E, one has to prove 
the existence of a form A, defined in E, such that dj = w. This amounts 
to solving a system of partial differential equations, not just locally, but 
in all of E. For example, to show that (104) is exact in a set E, one has 
to find a function (or 0-form) g € @’(E) such that 


(106) (Dig(x)=f(x) (xe FE, 1 <isn). 
Of course, (105) is a necessary condition for the solvability of (106). 


(b) Let w be an exact k-form in E. Then there is a (kK — 1!)-form A in E 
with dA = w, and Stokes’ theorem asserts that 


(107) [o=[a=fa 


for every k-chain v of class @” in E. 
If ‘¥, and ‘VY, are such chains, and if they have the same boundaries, 


it follows that 
i" ow [, @. 


In particular, the integral of an exact k-form in E is 0 over every 
k-chain in E whose boundary is 0. 

As an important special case of this, note that integrals of exact 
]-forms in E are 0 over closed (differentiable) curves in E. 


(c) Let w be a closed k-form in E. Then dw = 0, and Stokes’ theorem 
asserts that 


(108) f° - IF dw = 0 


for every (k + 1)-chain ¥ of class @” in E. 
In other words, integrals of closed k-forms in E are 0 over k-chains 
that are boundaries of (k + 1)-chains in E. 


(7d) Let ¥ bea (k + 1)-chain in E and let 4 be a (k — 1)-form in E, both 
of class @”. Since d?/ = 0, two applications of Stokes’ theorem show that 


(109) | [e2 = (ie dit {a2 = 0 


We conclude that 67% =0. In other words, the boundary of a 
boundary is 0. 
See Exercise 16 for a more direct proof of this. 
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10.36 Example Let E = R? — {0}, the plane with the origin removed. The 
1-form 

x dy — ydx 
110 = —>—_- 
(110) are 
is closed in R? — {0}. This is easily verified by differentiation. Fix r > 0, and 
define 


(111) y(t) = (r cos f, r sin’) (O<1t<2n). 


Then y is a curve (an “‘oriented !-simplex’’) in R* — {0}. Since »(0) = (27), 
we have 


(112) cy = 0. 


Direct computation shows that 
(113) [ n=2n#0. 
Y 


The discussion in Remarks 10.35(b) and (c) shows that we can draw two 
conclusions from (113): 


First, is not exact in R? — {0}, for otherwise (112) would force the integral 
(113) to be 0. 

Secondly, y is not the boundary of any 2-chain in R* — {0} (of class 6"), 
for otherwise the fact that 7 is closed would force the integral (113) to be 0. 


10.37 Example Let E = R° — {0}, 3-space with the origin removed. Define 


xdy ndz+ydzndx+zdx ady 
114 o ta eee ee ee 
( ) ¢ ee +y? 42 Ze 


where we have written (x, ), z) in place of (x,, x...x;). Differentiation shows 
that dC = 0, so that C is a closed 2-form in R° — {0}. 

Let £ be the 2-chain in R* — {0} that was constructed in Example 10.32: 
recall that £ is a parametrization of the unit sphere in R°. Using the rectangle 
D of Example 10.32 as parameter domain, it is easy to compute that 


(115) [c= sin u dude =4n 40, 
/y D 


As in the preceding example, we can now conclude that ¢ is nor exact in 
R? — {0} (since 8& = 0, as was shown in Example 10.32) and that the sphere £ 
is not the boundary of any 3-chain in R° — {0} (of class @”), although cL = 0. 
The following result will be used in the proof of Theorem 10.39. 
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10.38 Theorem Suppose E is a convex open set in R", fe €'(E), p is an integer, 
1 <p<n, and 
(116) (D;f)(x) =0 (p<j<n,xe E). 
Then there exists an F € @'(E) such that 
(117) (D, F (x) =f(x), (D; F)(x) = 0 (p<j<n,xeE). 
Proof Write x = (x’, x,, x"), where 
x = (x45... Xo SNR ay. . x,)- 


(When p=1, x’ is absent; when p=n, x” is absent.) Let V be the 
set of all (x’, x,)e R? such that (x’,x,, x")eEE for some x”. Being a 
projection of E, V is a convex open set in R?. Since E is convex and (116) 
holds, f(x) does not depend on x”. Hence there is a function gy, with 
domain V, such that 
I(x) = O(x’, x,) 

for all xe E. 

If p= 1, V is a segment in R' (possibly unbounded). Pick ce V 
and define 


F(R) =[" ot)ar (x € E). 


If p> 1, let U be the set of all x’ R?~' such that (x’, x,)€ V for 
some x,. Then U is a convex open set in R’~', and there is a function 
ae @(U) such that (x’, a(x’))€ V for every x’ e U; in other words, the 
graph of a lies in V (Exercise 29). Define 


F(x) = \ ne me 


a(x’) 


In either case, F satisfies (117). 
(Note: Recall the usual convention that [? means — {? if b <a.) 


10.39 Theorem Jf Ec R" is convex and open, if k > 1, if w is a k-form of 
class €' in E, and if dw = 0, then there is a (k — 1)-form 4 in E such that w = di. 


Briefly, closed forms are exact in convex sets. 


Proof For p=1,...,n, let Y, denote the set of all k-forms w, of class 
@’ in E, whose standard presentation 
(118) ‘w= YS Ax)axy 
i 


does not involve dx,,,,..., dx,. In other words, / < {1,..., pif f(x) # 0 
for some x € E. 
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We shall proceed by induction on p. 

Assume first that we Y,. Then w=/(x)dx,. Since dw=0, 
(D,f\(x) = Ofor 1 <j <n, xe £. By Theorem 10.38 there is an F € @'(£) 
such that D,F = fand D;F =0 for 1<j<n. Thus 


aF = (DF \e) dx; = fCordx, = w. 


Now we take p> | and make the following induction hypothesis: 
Every closed k-form that belongs to Y,_, is exact in E. 
Choose we Y, so that dw = 0. By (118), 


(119) a. 5 (D,f (x) dx, 0 dx, = doo =0. 
1 j=1 


Consider a fixed 7, with p< j<n. Each / that occurs in (118) lies in 
{l,..., p}. If 2,, 7, are two of these k-indices, and if J, # J,, then the 
(A + 1)-indices (/,,/), (14,,/) are distinct. Thus there is no cancellation, 
and we conclude from (119) that every coefficient in (118) satisfies 


(120) (D, f(x) = 0 Ge Ep <j sft). 
We now gather those terms in (118) that contain dx, and rewrite w 
in the form 
(121) w=a+t ) f(x) dx, A dx,, 
To 


where xe Y,_,, each Jy is an increasing (k — 1)-index in {1,..., p — I}, 


and J = (J), p). By (120), Theorem 10.38 furnishes functions F,; € @’(E) 


such that 
(122) Dery; vr: D,F,=9 Gp "= 77): 
Put 
(123) Bp = ¥, F(x) dx,, 
lo 


and define y = w — (—1)*~' dB. Since B is a (k — 1)-form, it follows that 
. 8 
To j=l 


pa 
Io j=l 
which is clearly in Y,_,. Since dw =0 and d’*f =0, we have dy = 0. 
Our induction hypothesis shows therefore that y=dyu for some 
(k — 1)-form pin E. If A= up + (—1)*~'B, we conclude that w = da. 
By induction, this completes the proof. 
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10.40 Theorem Fix k, 1<k<n. Let Ec R" be an open set in which every 
closed k-form is exact. Let T bea \-1 @’-mapping of E onto an open set Uc R" 
whose inverse S is also of class €". 

Then every closed k-form in U is exact in U. 


Note that every convex open set E satisfies the present hypothesis, by 
Theorem 10.39. The relation between E and U may be expressed by saying 
that they are ¢"-equivalent. 


Thus every closed form is exact in any set which is @"-equivalent to a convex 
open set. 


Proof Let w be a k-form in U, with dw =0. By Theorem 10.22(c), 
wy, is a A-form in E for which d(w;)=0. Hence w;=d/ for some 
(k — 1)-form 4 in E. By Theorem 10.23, and another application of 
Theorem 10.22(c), 


W = (W7)s = (dA)s = (As). 


Since A, is a (k — 1)-form in U, o is exact in U. 


10.41 Remark In applications, cells (see Definition 2.17) are often more con- 
venient parameter domains than simplexes. If our whole development had 
been based on cells rather than simplexes, the computation that occurs in the 
proof of Stokes’ theorem would be even simpler. (It is done that way in Spivak’s 
book.) The reason for preferring simplexes is that the definition of the boundary 
of an oriented simplex seems easier and more natural than is the case for a cell. 
(See Exercise 19.) Also, the partitioning of sets into simplexes (called “‘triangu- 
lation’’) plays an important role in topology, and there are strong connections 
between certain aspects of topology, on the one hand, and differential forms, 
on the other. These are hinted at in Sec. 10.35. The book by Singer and Thorpe 
contains a good introduction to this topic. 

Since every cell can be triangulated, we may regard it as a chain. For 
dimension 2, this was done in Example 10.32; for dimension 3, see Exercise 18. 

Poincaré’s lemma (Theorem 10.39) can be proved in several ways. See, 
for example, page 94 in Spivak’s book, or page 280 in Fleming’s. Two simple 
proofs for certain special cases are indicated in Exercises 24 and 27. 


VECTOR ANALYSIS 


We conclude this chapter with a few applications of the preceding material to 
theorems concerning vector analysis in R°. These are special cases of theorems 
about differential forms, but are usually stated in different terininology. We 
are thus faced with the job of translating from one language to another. 
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10.42 Vector fields Let F = F,e, + F,e, + Fe, be a continuous mapping of 
an open set E c R® into R°. Since F associates a vector to each point of E, F 
is sometimes called a vector field, especially in physics. With every such F is 
associated a 1-form 


(124) Ay =F, dx + F,dy + F; dz 
and a 2-form 
(125) Wp = F, dy n dz + F, dz an dx + F,dx n dy. 


Here, and in the rest of this chapter, we use the customary notation (x, y, z) 
in placevof (x;, x2. %3). 

It is clear, conversely, that every |-form / in E is /, for some vector field 
F in E, and that every 2-form w is we for some F. In R®, the study of 1-forms 
and 2-forms is thus coextensive with the study of vector fields. 

Ifue €'(E) is a real function, then its gradient 


Vu = (D,u)e, + (D, ue, + (Dz u)e, 


is an example of a vector field in E. 
Suppose now that F is a vector field in E, of class @’. Its curl V x F is the 
vector field defined in E by 


V x F =O “a D,;F,)e, = (D,;F, a D,F)e2 = @D,F; aa D, F,)e, 
and its divergence is the real function V - F defined in E by 
V-F=D,F, + D,F,+ D,F;. 


These quantities have various physical interpretations. We refer to the 
book by O. D. Kellogg for more details. 
Here are some relations between gradients, curls, and divergences. 


10.43 Theorem Suppose E is an open set in R°, ue @'(E), and G is a vector 
field in E, of class C”. 


@ FF =Vu hen x F =. 
@®) IF = Vx G,; then V-F =0. 


Furthermore, if E is @"-equivalent to a convex set, then (a) and (b) have 
converses, in which we assume that F is a vector field in E, of class €': 


(a’) IfV x F=0, then F = Vu for some ue @"(E). 
(b') IfV-¥F =0, then F = V x G for some vector field G in E, of class ©". 


Proof If we compare the definitions of Vu, V x F, and VF with the 
differential forms A, and wy given by (124) and (125), we obtain the 
following four statements: 
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F = Vu if and only if Ag =du. 
Voor=0 - if and only if dA, =0. 

f= VverG if and only if wp =ddg. 
V-F=0 if and only if dw, =0. 


Now if F = Vu, then A, = du, hence dig = d*u = 0 (Theorem 10.20), 
which means that V x F = 0. Thus (a) is proved. 

As regards (a’), the hypothesis amounts to saying that dA, = Oin E. 
By Theorem 10.40, A, = du for some 0-form u. Hence F = Vu. 

The proofs of (6) and (6’) follow exactly the same pattern. 


10.44 Volume elements The k-form 
day he NAM 


is called the volume element in R“. It is often denoted by dV (or by dV, if it 
seems desirable to indicate the dimension explicitly), and the notation 


(126) [ f@ dx, n-** Ady = ik fav 


is used when ® is a positively oriented k-surface in R* and f is a continuous 
function on the range of ®. 

The reason for using this terminology is very simple: If D is a parameter 
domain in R*, and if ® is a 1-1 @’-mapping of D into R‘“, with positive Jacobian 
Jq, then the left side of (126) is 


[ f@wo(u) du= J 00) dx, 


by (35) and Theorem 10.9. 


In particular, when f = 1, (126) defines the volume of ®. We already saw 
a special case of this in (36). 
The usual notation for dV, is dA. 


10.45 Green’s theorem Suppose E is an open set in R*, «€ @'(E), Be @'(E), 
and Q is a closed subset of E, with positively oriented boundary 6Q, as described 
in Sec. 10.31. Then 


(127) J_@ dx + Bdy)= i. (= 2 =) dA. 
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Proof Put A=adx + Bdy. Then 
dd = (D,a) dy a dx + (D,B) dx a dy 
= (D,B — Da) dA, 


and (127) is the same as 


i " ja. 


which is true by Theorem 10.33. 
With a(x, y) = —y and B(x, y) = x, (127) becomes 


(128) 4] (dy —ydx) = AQ), 


the area of Q. 
With a = 0, Bf = x, a similar formula is obtained. Example !10.12(b) con- 
tains a special case of this. 


10.46 Area elements in R? Let ® be a 2-surface in R°, of class 6’, with pa- 
rameter domain Dc R’. Associate with each point (u, v) € D the vector 


E(y, 2) (z, x) (x, y) 


(129) N(u, v) = a(u, he Ba, ») °? + 5(u, v) e;. 


The Jacobians in (129) correspond to the equation 
(130) (x, y, Z) = @(u, v). 


If fis a continuous function on ®(D), the area integral of f over ® is 
defined to be 


(131) | win | f(®(u, v))|N(u, v)| du de. 
® D 
In particular, when f = | we obtain the area of ®, namely, 
(132) AD) = | |N(w, v)| du de. 
D 


The foliowing discussion will show that (131) and its special case (132) 
are reasonable definitions. It will also describe the geometric features of the 
vector N. 

Write ® = g,e, + ~2,e, + G3e3, fix a point po =(Uo, %o)E D, put 
N =N(ppo), put 


(133) a; = (D,9;)(Po), B; = (D2 9;)(Po) (i = 1, 2, 3) 
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and let Te L(R’, R*) be the linear transformation given by 


(134) TG?) = y (a,u + B;v)e;. 
i=1 


Note that T = ®'(po), in accordance with Definition 9.11. 

Let us now assume that the rank of Tis 2. (If it is 1 or 0, then N = 0, and 
the tangent plane mentioned below degenerates to a line or to a on The 
range of the affine mapping 


(u, v) = P(Po) + T(u, v) 


is then a plane I, called the tangent plane to ® at po. [One would like to call 
Il the tangent plane at ®(p,), rather than at py ; if ® is not one-to-one, this runs 
into difficulties. | 

If we use (133) in (129), we obtain 


(135) N = (a2 Bs — %3 Bre, + (43 By — 1B 3)e2 + (2182 — &2 Byes, 
and (134) shows that 


3 3 
(136) Te, c= ay a;e;, Te, = ‘i B,e;. 
i= 1 i=1 


A straightforward computation now leads to 
(137) N+ (Tey) = 0 = N-=\(Teg). 


Hence N is perpendicular to I]. It is therefore called the normal to ® at po. 
A second property of N, also verified by a direct computation based on 

(135) and (136), is that the determinant of the linear transformation of R° that 

takes {e,, e,, 3} to {Te,, Te,, N} is |N|? > 0 (Exercise 30). The 3-simplex 


(138) (0, TeysTe,, NJ 


is thus positively oriented. 

The third property of N that we shall use is a consequence of the first two: 
The above-mentioned determinant, whose value is |N|?, is the volume of the 
parallelepiped with edges {0, 7e,], [0, Te], [0, NJ]. By (137), [0, N] is perpen- 
dicular to the other two edges. The area of the parallelogram with vertices 


(139) 0, Tey Te>, Tee, tes) 


is therefore |N|. 

This parallelogram is the image under 7 of the unit square in R*. If E 
is any rectangle in R’, it follows (by the linearity of 7) that the area of the 
parallelogram 7(E) is 


(140) A(T(E)) =|N|A(E) = [,IN(uo, v9) | du dv. 
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We conclude that (132)1s correct when ® is affine. To justify the definition 
(132) in the general case, divide D into small rectangles, pick a point (uo, 9) 
in each, and replace ® in each rectangle by the corresponding tangent plane. 
The sum of the areas of the resulting parallelograms, obtained via (140), is then 
an approximation to A(®). Finally, one can justify (131) from (132) by apprexi- 
mating f by step functions. 


10.47 Example Let 0<a<b be fixed. Let K be the 3-cell determined by 


0 a <a, 0 < u <2n, O<v<2rn. 
The equations 
X =f COS U 
(141) y = (6b + fsin uv) cos v 


z=(b+1sinu)sine 


describe a mapping ¥ of R® into R® which is I-! in the interior of K, such that 
‘Y(K) is a solid torus. Its Jacobian is 
ha CX .ae 2) 


= -- —=l(b+ 7sinu) 
os OU, Us v) 


which is positive on K, except on the face r= 0. If we integrate Jy over K, we 
obtain 


vol (W(K)) = 277a7b 


as the volume of our solid torus. 

Now consider the 2-chain ® = CW. (See Exercise 19.) ‘Wy maps the faces 
u =O and wv = 22 of K onto the same cylindrical strip, but with opposite orienta- 
tions. ‘¥ maps the faces v = 0 and v = 27 onto the same circular disc, but with 
opposite orientations. ‘Y maps the face f = 0 onto a circle, which contributes 0 
to the 2-chain ¢W. (The relevant Jacobians are 0.) Thus ® is simply the 2-surface 
obtained by setting t = a in (141), with parameter domain D the square defined 
by Ox u < 2n, OS < 2r. 

According to (129) and (141), the normal to ® at (u, v)e€ D 1s thus the 
vector 


N(u, v) = a(b + a sin u)n(u, v) 
where 


n(u, v) = (cos u)e, + (sin u cos re, + (sin u sin v)e;. 
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Since |n(u, v)| = 1, we have |N(u, r)| = a(6 + asin uv). and if we integrate this 
over D, (131) gives 


A(®) = 4n?ab 


as the surface area of our torus. 

If we think of N= N(u,v) as a directed line segment, pointing from 
O(u, v) to O(u, v) + N(u, v), then N points outward, that is to say, away from 
(K). This is so beeause Jy > 0 when tf = a. 

For example, take u = v = 1/2, t= a. This gives the largest value of z on 
W(K), and N = a(b + a)e, points ‘upward’ for this choice of (uv, v). 


10.48 Integrals of 1-forms in R? Let ) be a @’-curve in an open set Ec R®, 
with parameter interval [0, 1], let F be a vector field in E, as in Sec. 10.42, and 
define 4, by (124). The integral of A, over y can be rewritten in a certain way 
which we now describe. 

For any uve [0, 1], 


yu) = yi(ue, + y2(wer + rae; 


is called the tangent vector to y at u. We define t = t(w) to be the unit vector in 
the direction of y’(u). Thus 


y'(u) = | y'(w)| tu). 


(If y'(u) = 0 for some u, put t(v) = e,; any other choice would do just as well.] 
By (35), 


S) [ 
J 2e=¥ | FGeorvite du 
(142) =f F(x(u)) + y'(u) du 


=" F(y(u)) + tu) | ye) | du 


Theorem 6.27 makes it reasonable to call | y'(u)| du the element of arc 
length along y. A customary notation for it is ds, and (142) is rewritten in the 
form 


(143) | ig= | (F< t) ds. 


Since t is a unit tangent vector to y, F «tis called the tangential component 
of F along y. 
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The right side of (143) should be regarded as just an abbreviation for the 
last integral in (142). The point is that F is defined on the range of y, but t is 
defined on (0, 1]; thus F +t has to be properly interpreted. Of course, when y 
is one-to-one, then t(w) can be replaced by t(y(u)), and this difficulty disappears. 


10.49 Integrals of 2-forms in R® [ct ® be a 2-surface in an open set Ec R®, 
of class G’, with parameter domain Dc R’. Let F be a vector field in E, and 
define w, by (125). As in the preceding section, we shall obtain a different 
representation of the integral of w, over ®. 

By (35) and (129), 


| a, = [ (F, dy a dz + F, dz a dx + F; dx a dy) 
® “@® 


, Cy. Z) (EY | 
- im a rota, v) ‘oo C(u, v) aaa C(u, v) ae 


= [ F(@(u, v)) - N(u, 0) du de. 
“D 


Now let n=n(u,v) be the unit vector in the direction of N(w, v). [If 
Niu, ¢) = 0 for some (u,v) € D, take n(u, vr) = e,.) Then N = {Njn, and there- 
fore the Jast integral becomes 


F(®(u, v)) + n(u, v)| N(u, v)| du de. 
D 
By (131), we can finally write this in the form 
(144) [ wp={ (Fem) da. 
“o ® 
With regard to the meaning of F +n, the remark made at the end of Sec. 10.48 


applies here as well. 
We can now state the original form of Stokes’ theorem. 


10.50 Stokes’ formula [fF is a vector field of class 6’ in-an open set Ec | ae 
and if ® is a 2-surface of class 6" in E, then 


(145) [ (Wx F)-nds=| (F-t)ds. 
c® 


“® 


Proof Put H=V ~x F. Then, as in the proof of Theorem 10.43, we have 


(146) Wy = dig. 
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Hence 


[ x F):ndA= [a dA = [ow 


=| dir=| a= [ 9 ds. 


Here we used the definition of H, then (144) with H in place of F, 
then (146), then—the main step—Theorem 10.33, and finally (143), 
extended in the obvious way from curves to 1-chains. 


10.51 The divergence theorem Jf F is a vector field of class €' in an open set 
Ec R®, and if Q is a closed subset of E with positively oriented boundary €Q 


(as described in Sec. 10.31) then 
(147) { (VF) dV = { (Fn) dA. 
2 @n 


Proof By (125), 
da, = (V °F) dx a dy an dz=(V: F) av. 
Hence 


[. (V-F)dV= jdoe - [oe : {fm dA. 


by Theorem 10.33, applied to the 2-form w,, and (144). 


EXERCISES 
1. Let H be a compact convex set in R*, with nonempty interior. Let fe G(H), put 
f(x) = 0 in the complement of H, and define {,, fas in Definition 10.3. 
Prove that | f is independent of the order in which the k integrations are 


carried out. 
Hint: Approximate f oy functions that are continuous on R* and whose 
supports are in #7, as was done in Example 10.4. 
2. For : = 1, 2,3)..., ketepme@@R") have support iny(2~‘, 2'-'), suchithat ior—al. 
Put 


ri pe (pi(x) — Pi+ ix] gi(y) 
Then f has compact support in R?, fis continuous except at (0, 0), and 
[ dy | f(x,yydx=0 but | dx | fee) =A. 


Observe that f!s unbounded in every neighborhood of (0, 0). 
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3. (a) If F is as in Theorem 10.7, put A = F’(0), F,(x) = A~'F(x). Then F({(0) =: /. 
Show that 


F(x) = G,¢G,_, 6--- > G(x) 


in some neighborhood of 0, for certain primitive mappings G,,....G,. This 
gives another version of Theorem 10.7: 


F(x) = F‘(0)G, 9° Gres Ce ee G.,4 &). 


(6) Prove that the mapping (x, )') --(), x) of R? onto R? is not the composition 
of any two primitive mappings, in any neighborhood of the origin. (This shows 
that the flips B, cannot be omitted from the statement of Theorem 10.7.) 

4. For (x, y) € R?’, define 


F(x, y) = (e* cos y — |, e* sin y). 
Prove that F = G, o G,, where 
G,(x, y) = (e* cos y — I, y) 
G,(u, v) = (vu, (1 + uv) tance) 


are primitive in some neighborhood of (0, 0). 
Compute the Jacobians of G,, G,, F at (0,0). Define 


H.(x, »’) = (x, e* sin y) 
and find 
H ,(u, v) = (Aas, v), v) 


so that F = H, o H; is some neighborhood of (0, 0). 

5. Formulate and prove an analogue of Theorem 10.8, in which K is a compact 
subset of an arbitrary metric space. (Replace the functions g, that occur in the 
proof of Theorem 10.8 by functions of the type constructed in Exercise 22 of 
Chap. 4.) 

6. Strengthen the conclusion of Theorem 10.8 by showing that the functions J, can 
be made differentiable, and even infinitely differentiable. (Use Exercise | of 
Chap. 8 in the construction of the auxiliary functions 7; .) 

7. (a) Show that the simplex Q* is the smallest convex subset of R* that contains 
Oe... Ck. 

(b) Show that affine mappings take convex sets to convex sets. 

8. Let H be the parallelogram in R? whose vertices are (1, 1), (3, 2), (4, 5), Q, 4). 
Find the affine map T which sends (0, 0) to (1, 1), (1, 0) to (3, 2). (O, 1) to (2, 4). 
Show that J; = 5. Use T to convert the integral 


oe — [ e* da dy 
eH 


to an integral over J? and thus compute . 
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Dd: 


10. 


HH, 


12. 


Define (x, y) = T(r, 9) on the rectangle 
= pam, 0<0<27r 


by the equations 
xm. cog y=rsin 0. 
Show that T maps this rectangle onto the closed disc D with center at (0, 0) and 


radius a, that 7 is one-to-one in the interior of the rectangle, and that J7(r, 4) == r. 
If fe G(D), prove the formula for integration in polar coordinates: 


[, fx, vaxap= I. i f(T(r, 8) dr dd. 


Hint: Let Do be the interior of D, minus the interval from (0, 0) to (0, a). 
As it stands, Theorem 10.9 applies to continuous functions f whose support Jies in 
Do. To remove this restriction, proceed as in Example 10.4. 
Let a— © in Exercise 9 and prove that 


ws 2" 
{ f(x, y) dx dy = | { S(T(r, 9))r dr dé, 
R2 ao = 0 


for continuous functions f that decrease sufficiently rapidly as|x| + |y| > x. 
(Find a more precise formulation.) Apply this to 
fay) eR — x? — ve) 
to derive formula (101) of Chap. 8. 
Define (u, v) = T(s, t) on the strip 
OQ: <SSex<ea, Oi fax J 
by setting u~ s — st, v == st. Show that T is a J-! mapping of the strip onto the 
positive quadrant Q in R?. Show that J7r(s, f) = s. 
For x > 0, y > 0, integrate 
“ur ic Br te-* 
over Q, use Theorem 10.9 to convert the integral to one over the strip, and derive 
formula (96) of Chap. 8 in this way. 
(For this application, Theorem 10.9 has to be extended So as to cover certain 
improper integrals. Provide this extension.) 
Let /* be the set of all u= (uw, ..., uy) € R* withO <u, <1 for all i; let O* be the 
setvof all, x ==(x4, ..., xepe R with x, > 0, Ix, <1. (/* is the unit. cube: @* is 
the standard simplex in R*.) Define x = T(u) by 
xX, Wy 
X2== (1 — m1) 


ereeeceeeer see eeseceesanee sess neene 


Xe = (l= a) +++ (LE aged. 


13; 


14. 
15. 


16. 


M7. 


18. 
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Show that 


¥ x= 1—[] = wy. 


Show that T maps /* onto Q*, that 7 is 1-1 in the interior of /*, and that its 
inverse S is defined in the interior of Q* by u, = x, and 


Xi 
CE ———————— 
b—x,— °° — Xe 


for l= 2, ..., Snow tat 
Jake) SG — tah” *Clerua)Po? od ty) 
and 
Soe le ee a = (ee ee. 
Let ri,..., r, be nonnegative integers, and prove that 


pul: -- Rat 


Xjee 4! dit =e 
J. ‘ (Ktrnte-+n)! 


Hint: Use Exercise 12, Theorems 10.9 and 8.20. 

Note that the special case r, = --: =r, =0 shows that the volume of Q* 
is 1/k!. 
Prove formula (46). 
If w and A are k- and m-forms, respectively, prove that 


w \ A\=(—1)*"0 A w. 


If k >2and o = [po, pi, ...,,Px] is an oriented affine k-simplex, prove that 070 = 0, 
directly from the definition of the boundary operator @. Deduce from this that 
0?‘¥ = 0 for every chain ¥’. 

Hint: For orientation, do it first for k = 2, k = 3. In general, if i<j, let o,, 
be the (A — 2)-simplex obtained by deleting p, and p, from o. Show that each o,, 
occurs twice in 270, with opposite sign. 
Put J? = 7, + 72, where 


aS (0, ©1,@e; =" e,], T2> 7 [0, @2, &2 + e,]. 


Explain why it is reasonable to call J? the positively oriented unit square in R*. 
Show that 0J? is the sum of 4 oriented affine !-simplexes. Find these. What is 
Or, — 72)? 

Consider the oriented affine 3-simplex 


a, =( ewe; + Gwe, + ec, + es] 


in R*®. Show that o, (regarded as a linear transformation) has determinant 1. 
Thus o, is positively oriented. 
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19: 


20. 


21. 


Let o,,..., 0.6 be five other oriented 3-simplexes, obtained as follows: 
There are five permutations (/;, (2, 73) of (1, 2, 3), distinct from (1, 2, 3). Associate 
with each (i,, i2, is) the simplex 


sii, lings i;){0, Ci, Cy PRRs Ci, + C2 + e153] 


where s is the sign that occurs in the definition of the determinant. (This is how 7, 
was obtained from 1, in Exercise 17.) 

Show that o2,..., o¢ are positively oriented. 

Put J? = 0, +++: -+ a5. Then J® may be called the positively oriented unit 
cube in R°. 

Show that 2J? is the sum of 12 oriented affine 2-simplexes. (These 12 tri- 
angles cover the surface of the unit cube /°.) 

Show that x = (x1, x2, X3) iS in the range of o, if and only if O0<x3< x2 
= xis li 

Show that the ranges of o,,..., 06 have disjoint interiors, and that their 
union covers J*. (Compare with Exercise 13; note that 3! = 6.) 
Let J? and J* be as in Exercise 17 and 18. Define 


Bo. (u, v) = (0, u, v), B,,(u, v) = (1, u, v), 
Bolu, v) a (u, 0, v), B, 2(u, v) ae (u, be v); 
Bo3(u, v) = (u, v, 0), B,3(u, v) = (a, v, 1). 


These are affine, and map R? into R?. 
Put 8,; = 8,.(J7), for r=0,1,i=1, 2,3. Bach ®,, is an affine-oriénted 
2-chain. (See Sec. 10.30.) Verify that 


EP = ¥ (= 1\Boi — Bid 


in agreement with Exercise 18. 
State conditions under which the formula 


[ fdw = [ fo- [adn ne 


is valid, and show that it generalizes the formula for integration by parts. 
Hint: d( fw) = (df) A w+ fdw. 
As in Example 10.36, consider the 1-form 


x dy —ydx 
yh y? 


in R? -~ {0}. 
(a) Carry out the computation that leads to formula (113), and prove that dy = 0. 


(b) Let (t) = (r cos t, r sin t), for some r > 0, and let [ be a @’-curve in R? — {0}, 
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with parameter interval [0, 27], with I'(0) = I'(27), such that the intervals [y(1), 
I'(t)] do not contain 0 for any ¢ € [0, 277). Prove that 


[ 9=2n. 
2 


Hint: ForO0 <t<27,0<u <1, define 
O(1, wu) = (1 — wu) M(t) + uy(t). 


Then ® is a 2-surface in R? — {0} whose parameter domain is the indicated rect- 
angle. Because of cancellations (as in Example 10.32), 


co = T~— y. 


Use Stokes’ theorem to deduce that 


because dy = 0. 


(c) Take I(t) =(acos?,bsint) where a>>0,b>0 are fixed. Use part (b) to 
show that 


2" ab — 
dt = 2 
f. a? cos? + 6b? sin? t 


(d) Show that 
ai nd 
n= a( are tan *) 
in any convex open set in which x ~ 0, and that 
n= a(— arc tan”) 


in any convex open set in which y + 0. 
Explain why this justifies the notation 7 = dé, in spite of the fact that 7 is 
not exact in R? — {0}. 


(e) Show that (6) can be derived from (d). 
(f) If T is any closed @’-curve in R? — {0}, prove that 


I 
= = Ind(1). 
al ils 


(See Exercise 23 of Chap. 8 for the definition of the index of a curve.) 
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22. As in Example 10.37, define ¢ in R* — {0} by 
_xdy \dz+ydz \dx+zdx / dy 


3 


C 


r 


where r = (x? + y? + z?)'/?, let D be the rectangle given by0 <u <7,0<0< 27, 
and let = be the 2-surface in R*, with parameter domain D, given by 


x = sin ucos v, y= Sin u sin v, Z==MCHS Hh. 


(a) Prove that df = 0 in R? — {0}. 


(b) Let S denote the restriction of © to a parameter domain E < D. Prove that 
| i | sin udu dv = A(S), 
s E 
where A denotes area, as in Sec. 10.43. Note that this contains (115) as a special 


case. 


(c) Suppose g, 4,,h2.,h3, are @”-functions on [0, 1}, g -~ 0. Let (x, 3, z) = Ms, r) 
define a 2-surface , with parameter domain /*, by ° 


x= g(thi(s), y=g(t)h2(s), z =219(0)N 50s). 


Prove that 


[ ¢=0, 
®D 
directly from (35). 
Note the shape of the range of ®: For fixed s, P(s, ¢) runs over an interval 
on a line through 0. The range of ® thus lies in a “‘cone™ with vertex at the origin. 


(d) Let E be a closed rectangle in D, with edges parallel to those of D. Suppose 
fe (D),f>0. Let 2 be the 2-surface with parameter domain E, defined by 


Qe ey== Paty Sst). 


Define S as in (b) and prove that 


[e = [t= A(S). 


(Since S is the “radial projection” of into the unit sphere, this result makes it 
reasonable to call Jag the “‘solid angle” subtended by the range of {2 at the origin.) 
Hint: Consider the 3-surface I" given by 


F(t, u,v) = [I — + -- f(a, v)] ¥ (a, v), 


where (u,7¥e E,O<¢<1. For fixed v, the mapping (1, w) -> (1, u, t) is a 2-sur- 
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face ® to which (c) can be applied to show that fo¢- 0. The same thing holds 
when « is fixed. By (a) and Stokes’ theorem, 


j,k [ d=. 


(ce) Put A=- — (z/r)n, where 
x dy—ydx 
x? 4 y ’ 
as in Exercise 21. Then A is a 1-form in the open set V < R? in which x? + y? > 0. 
Show that € is exact in V by showing that 
{a@.. 
(f) Derive (d) from (e), without using (c). 
Hint: To begin with, assume 0 <u -< 7 on E. By (e), 


| i | Ki and { = {. A. 


Show that the two integrals of \ are equal, by using part (d) of Exercise 21, and by 
noting that z/r is the same at <(u, v) as at Q(y, v). 


(g) Is ¢ exact in the complement of every line through the origin? 


. Fix n. Define r, = (x? = +++ -+ x?)''? for 1< k <n, let E, be the set of all x € R" 


at which r, >> 0, and let w, be the (k -- 1)-form defined in F, by 
k 
Wy = ene 2 Ca) ‘wamdsignens NER, WH Bima -* A axe. 
Note that w, == 7, ws = ¢, in the terminology of Exercises 21 and 22. Note 
also that 
i, SE, on Qe, RR” —aoy 
(a) Prove that dw, = Oin E,. 
(6) For k =2,...,n, prove that w, is exact in E,-,, by showing that 
Wy, = d(fiws-1) = (afi) COPE 1, 


where f,(x) == (—1)* g,(x,/r.) and 
aa) = ii Berm (1 < HED). 
-1 


Hint: f, satisfies the differential equations 
x (Vf,)(x) = 0 
and 
(— ie, ar" 


D, k ‘aii 
(Di f(x) (r.)* 
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25. 


26. 


27. 


(c) Is w, exact in E,? 
(d) Note that (5) is a generalization of part (e) of Exercise 22. Try to extend some 
of the other assertions of Exercises 21 and 22 to w,, for arbitrary 7. 


. Let w =Za;,(x) dx; be a 1-form of class @” in a convex open set E< R". Assume 


dw = 0 and prove that w is exact in E, by completing the following outline: 
Fix pe E. Define 


fx) = | w (x € E). 
(p.x) 


Apply Stokes’ theorem to affine-oriented 2-simplexes [p, x, y] in E. Deduce that 
n 1 
fy) ~ £0) = Fi — x) | ad — Ox + ty) dt 


for x € E,y €¢ E. Hence (D,f)(x) = a,(x). 
Assume that w is a 1-form in an open set E < R" such that 
( w= 
“y 
for every closed curve y in E, of class @’. Prove that w is exact in E, by imitating 
part of the argument sketched in Exercise 24. 


Assume w is a 1-form in R? — {0}, of class @’ and dw =0. Prove that w is exact in 
R?* — {0}. 

Hint: Every closed continuously differentiable curve in R?— {0} is the 
boundary of a 2-surface in R* — {0!. Apply Stokes’ theorem and Exercise 25. 


Let E be an open 3-cell in R*, with edges parallel to the coordinate axes. Suppose 
(a,b, c\E E,f, € G@ (E) for i=1, 2, 3, 


w=fsidy \ dz+ fi dz /\ dx + f3 dx /\\ ay, 


and assume that dw = 0Oin E. Define 


A=g, dx +92 dy 


where 
g(x, y, Z) = | S2(x, y, 8) ds — { I sheet, c)-dt 
c 5 


g(x,y, Z)= -| fi(x, y, 5) ds, 


for (x. y, z)€ E. Prove that dA = w in E. 
Evaluate these integrals when w = ¢ and thus find the form A that occurs in 
part (e) of Exercise 22. 


28. 


2o: 


Sl. 
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Fix 6 > a> 0, define 
P(r, 6) = (r cos 8, rsin 8) 


fora<r<sb,0<8<2m. (The range of ® is an annulus in R?.) Put w = x? dy, 
and compute both 


{ dw and | w 
® cd 


to verify that they are equal. 

Prove the existence of a function x with the properties needed in the proof of 
Theorem 10.38, and prove that the resulting function F is of class @’. (Both 
assertions become trivial if E is an open cell or an open ball, since « can then be 
taken to be a constant. Refer to Theorem 9.42.) 


. If N is the vector given by (135), prove that 


x B, «2B — a3B> 

det | x, 8, a spr — aiBs = [N| < 
Xs B> iB. = a 2B, 

Also, verify Eq. (137). 

Let E < R® be open, suppose g ¢ %(E),h € G(E), and consider the vector field 

FegtTT 

(a) Prove that 
V:-F=gV?7h-+ (Vg): (VA) 

where V2/ = V+ (Vit) == SE2h/cx? is the so-called ‘‘Laplacian”’ of A. 


(b) If 2 is a closed subset of E with positively oriented boundary ¢€Q (as in 
Theorem 10.51), prove that 


[ [9 ¥2h = (Tg): (TAylaV = | g 2H 
Ja geet 
where (as is customary) we have written ¢//én in place of (VA): n. (Thus ¢h/en 
is the directional derivative of / in the direction of the outward normal to ¢Q, the 
so-called normal derivative of h.) Interchange g and A, subtract the resulting 
formula from the first one, to obtain 


| @ Vth — ng) dV = (05 lege 
2 on 


These two formulas are usually called Green’s identities. 
(c) Assume that / is harmonic in E; this means that V2/ -- 0. Take g = I and con- 
clude that 
ch 
| =a4~o. 
Co 


nen 
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32. 


Take g = h, and conclude that 4 = 0 in © if h = 0 on €Q., 
(d) Show that Green’s identities are also valid in R?. 


Fix 5,0 <8 <1. Let D be the set of all (0, ¢) € R? such thatO0 <8 <7, —§21<%. 
Let ® be the 2-surface in R3, with parameter domain D, given by 


x = (1 — tsin 0) cos 26 
y= (1 —¢sin 8) sin 20 
z= teos 0 


where (x, y, z) = 0(0, t). Note that (7, r) = ®(0, —1), and that ® is one-to-one 
on the rest of D. 

The range M = ®(D) of ® is known as a Mobius band. It is the simplest 
example of a nonorientable surface. 

Prove the various assertions made in the following description: Put 
p: = (0, —$), p2 = (7, —), ps = (1, 5), pa == (0, 5), Ps =p. Put y: = [p:, piss), 
i=1,...,4,and put [,;= @Doy,. Then 


e® =T,4+T,+734+T,. 
Put a = (1, 0, — 5), b = (1, 0, 5). Then 
O(p.1)= O(ps)=a, P(p.) = P(p.s) =b, 


and @® can be described as follows. 

I’, spirals up from a to b; its projection into the (x, y)-plane has winding 
number ++] around the origin. (See Exercise 23, Chap. 8.) 

lr, = (bral. 

I; spirals up from a to b; its projection into the (x, y) plane has winding 
number —1 around the origin. 

, => [b, a]. 

Thus o® = 1T, +1T;+4 2IF,. 

If we go from a to b along I, and continue along the “‘edge”’ of M until we 
return to a, the curve traced out is 


Yr — | a — Yr; 9 
which may also be represented on the parameter interval [0, 271] by the equations 


x = (1+ 6 sin 8) cos 26 
y= (1 + 8 sin 9) sin 20 
z= —dcos 6. 


It should be emphasized that [ #c®: Let » be the 1!-form discussed in 
Exercises 21 and 22. Since dy = 0, Stokes’ theorem shows that 


n = 0. 
6@ 
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But although I’ is the “‘geometric’” boundary of M, we have 


[on = 4n. 
fb 


In order to avoid this possible source of confusion, Stokes’ formula (Theorem 
10.50) is frequently stated only for orientable surfaces 9. 


I] 


THE LEBESGUE THEORY 


It is the purpose of this chapter to present the fundamental concepts of the 
Lebesgue theory of measure and integration and to prove some of the crucial 
theorems in a rather general setting, without obscuring the main lines of the 
development by a mass of comparatively trivial detail. Therefore proofs are 
only sketched in some cases, and some of the easier propositions are stated 
without proof. However, the reader who has become familiar with the tech- 
niques used in the preceding chapters will certainly find no difficulty in supply- 
ing the missing steps. 

The theory of the Lebesgue integral can be developed in several distinct 
ways. Only one of these methods will be discussed here. For alternative 
procedures we refer to the more specialized treatises on integration listed in 
the Bibliography. 


SET FUNCTIONS 


If A and B are any two sets, we write A — B for the set of all elements x such 
that x € A, x ¢ B. The notation A — B does not imply that Bc A: We denote 
the empty set by 0, and say that 4 and B are disjoint if AN B = 0. 
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11.1 Definition A family # of sets is called a ring if Ae @ and B € & implies 
(1) AU BES, A-—BeR. 

Since A A B= A — (A — B), we also have An Be Bif B is a ring. 

A ring & is called a a-ring if 
(2) 4,62 


whenever 4, € & (n = 1, 2, 3, ...). Since 


io ©) 


(\ 4, = Ai ~ (A, = AD), 


we also have 


if @ is a o-ring. 


11.2 Definition We say that @ is a set function defined on # if ¢ assigns to 
every A € # a number (A) of the extended real number system. @ is additive 
if A ~ B= 0 implies 


(3) P(A UL B) = G(A) + G(B), 
and @ is countably additive if A; 0 A; = 0 (i #/) implies 
(4) 6(U4,) = 44). 


We shall always assume that the range of @ does not contain both + 00 
and — oo; for if it did, the right side of (3) could become meaningless. Also, 
we exclude set functions whose only value is +00 or —0oo. 

It is interesting to note that the left side of (4) is independent of the order 
in which the A,'s are arranged. Hence the rearrangement theorem shows that 
the right side of (4) converges absolutely if it converges at all; if it does not 
converge, the partial sums tend to +00, or to — oo. 

If d is additive, the following properties are easily verified: 


(5) g(0) = 0. 
(6) P(A, °** VA,) = G(A,) + °° + A,) 


if A; 0 A; = 0 whenever i ¥ /. 
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(7) P(A; U Ax) + P(A, 0 Az) = P(A,) + GLAD). 
If #(A) > 0 for all A, and A, < A;, then 
(8) f(A) < P(A2). 


Because of (8), nonnegative additive set functions are often called 
monotonic. 


(9) p(A — B) = $(A) — $(8B) 
if Bc A, and |(@B)| < + o. 


11.3 Theorem Suppose ¢ is countably additive on a ring &. Suppose A,€ # 
(= 1,2)3,...), MH Gly CAD: pe CR 


A= U An. 
Then, asn—> %, 
$(A,) > P(A). 
Proof Put B, = A,;, and 
B,=A,— An-1 ‘lial AE ee 
Then B, 0B, =0 fori #/j, A, = B, UU B,, and A = UB,. Hence 


(Ay) = Y OB) 


and 


HA) = Y OB). 


CONSTRUCTION OF THE LEBESGUE MEASURE 


11.4 Definition Let R? denote p-dimensional euclidean space. By an interral 
in R? we mean the set of points x = (x,,..., x,) such that 


(10) =x, =, (=f, ....c, 


or the set of points which is characterized by (10) with any or all of the < 
signs replaced by <. The possibility that a; = 6; for any value of i is not ruled 
out; in particular, the empty set is included among the intervals. 
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If A ts the union of a finite number of intervals, A ts said to be an elemen- 
fary set. 
If 7 is an interval, we define 


Pp 
m1) = [] (6; — a;), 
i=1 
no matter whether equality is included or excluded in any of the inequalities (10). 
If A=/,U--:Ul,, and if these intervals are pairwise disjoint, we set 
(11) n(A) = m(/,) + -°° + m(/,). 
We let & denote the family of all elementary subsets of R?. 


At this point, the following properties should be verified: 


(12) & is a ring, but not a o-ring. 

(13) If Ae 4, then A is the union of a finite number of disjoint intervals. 

(14) If A € &, m(A) is well defined by (11); that is. if two different decompo- 
sitions of A into disjoint intervals are used, each gives rise to the same 
value of m(A). 

(15) m1 is additive on 6. 


Note that if p = 1, 2.3, then a7 is length, area, and volume, respectively. 


11.5 Definition A nonnegative additive set function @ defined on & is said to 
be regular if the following is true: To every A€6 and to every e >O there 
exist sets Fe 6. Ge& such that F is closed, G is open, F < A c G, and 


(16) p(G) —€ < @(A) < O(F) +. 


11.6 Examples 


(a) The set function m is regular. 

If A is an interval, it is trivial that the requirements of Definition 
11.5 are satisfied. The general case follows from (13). 
(b) Take R?=R', and let x be a monotonically increasing func- 
tion, defined for all real x. Put 


u([a, b)) = a(b—) — a(a—), 
1((a, 6]) = a(b+) — a(a—), 
u((a, 6}) = a(b+) — x(a +), 
u((a, b)) = a(b—) — (a+). 


Here [a,) is the set a< x <b, etc. Because of the possible discon- 
linuities of a, these cases have to be distinguished. If y is defined for 
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elementary sets as in (11), w is regular on &. The proof is just like that 
of (a). 


Our next objective is to show that every regular set function on 6 can be 
extended to a countably additive set function on a o-ring which contains @. 


11.7 Definition Let pu be additive, regular, nonnegative, and finite on @. 
Consider countable coverings of any set E < R? by open elementary sets A,: 
DE U An. 

Define : 
(17) ger) 10f YH An), 


the inf being taken over all countable coverings of E by open elementary sets. 
u*(E) is called the outer measure of E, corresponding to 1. 
It is clear that u*(£) > 0 for all E and that 


(18) (PEE) aperte) 
if (op = E, ; 


11.8 Theorem 
(a) For every AEE, p*(A) = pA). 
(6) IfE=\) E,, then 
1 


(19) pMEVE Yate, 
n=1 
Note that (a) asserts that u* is an extension of y from & to the family of 
all subsets of R’. The property (19) is called subadditivit y. 
Proof Choose A €@ and e>0. 


The regularity of 4 shows that A is contained in an open elementary 


set G such that u(G) < u(A) +e. Since y*(A) < u(G) and since ¢ was 
arbitrary, we have 


(20) u*(A) < p(A). 
The definition of u* shows that there is a sequence {A,} of open 


elementary sets whose union contains A, such that 


2 w(A,) < p*(A) + €. 
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The regularity of j¢ shows that 4 contains a closed elementary set F such 
that 4u(F) > (A) — €; and since F is compact, we have 


reminw * ~ ge 


for some N. Hence 
N 
W(A) < WF) + € < (A, Ut U Ax) HES DY WA,) + € < eA) 4 28. 
J 


In conjunction with (20), this proves (a). 

Next, suppose E = UE,. and assume that x*(E,) < + o for all n. 
Given ¢> 0, there aré coverings {4,,},k = 1.2.3,..., of E, by open 
elementary sets such that 


TF 


(21) SY WMA) < E,) + 27>". 
1 


Then 


jOle a 2 Y (Am) BNE) + a 


= i 


and (19) follows. In the excluded case, t.e.. if ye*(£,) = + 2% for some 7, 
(19) is of course trivial. 


11.9 Definition For any Ac RR’, Bc R?, we define 
(22) S(A, B) =(A — B) VU (B — A). 
(23) (A. B) = *(S(A, B)). 
We write A, > A if 
lim d(A, A,) = 0. 


If there is a sequence {A,} of elementary sets such that 4, > A. we say 
that A is finitely jt-measurable and write A € Wi,-(j0). 

If A is the union of a countable collection of finitely s-measurable sets, 
we say that A is pt-measurable and write A € Wp). 

S(A, B) is the so-called “symmetric difference” of A and B. We shall see 
that dA, B) is essentially a distance function. 

The following theorem will enable us to obtain the desired extension of 44. 


11.10 Theorem YW) is a a-ring, and yt* is countably additive on W(40). 


Before we turn to the proof of this theorem. we develop some of the 
properties of S(A, B) and d(A, B). We have 
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(24) S(AwB) =SEB uA); MA,.A) = 0: 
(25) Se, By SS, CHO OSt BY. 
S(A, U Az, By Uv By) 
(26) S(A, 0 Az. By O By)}) & S(Ay, By) U S(A2, Bo). 


S(A, — A,, B, — Bo) 
(24) is clear, and (25) follows from 
(A — B)c(A-—C)uU(C — B), (B — A)c(C— A) U(B-C). 
The first formula of (26) is obtained from 
(A, UV A,) — (B, VU By) < (A; — Bw (A2 — By). 
Next, writing E° for the complement of E, we have 
S(Ay oO A, By Bs) = SEAT A. Be BB) 
S S(A‘,. Bi) w S(A4,. BP = SAy. B,) oe Sida): 
and the last formula of (26) is obtained if we note that 
Ay A, A Pree. 
By (23), (19), and (18), these properties of S(4, B) imply 


(27) d(A, B)=d(B, A).  ad(A, A) =9, 
(28) d(A, B) < d(A, C) + d(C. B), 
MA, VU Ay, Bw BD 
(29) MA, 0 A,. By A By)} S d(Ay, B,) + d(A,. B,). 


dA, — A>. B, oe, B,) 


The relations (27) and (28) show that d(4, B) satisfies the requirements 
of Definition 2.15, except that d(A, B) = 0 does not imply A = B. For instance, 
if « =m, A is countable, and B is empty, we have 


GtAwb i= F(A) =O, 
to see this, cover the mth point of A by an interval J, such that 
mJ.) < 27 "Ee. 
But if we define two sets A and B to be equivalent, provided 
d(A, B) = 0, 


we divide the subsets of R? into equivalence classes, and d(A, B) makes the set 
of these equivalence classes into a metric space. Yt,-(4s) is then obtained as the 
closure of &. This interpretation is not essential for the proof, but it explains 
the underlying idea. . 


(30) 
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We need one more property of d(A, B), namely, 
| u*(A) — #*(B)| < dA, B), 


if at least one of y*(A), u*(B) is finite. For suppose 0 < p*(B) < p*(A). 
Then (28) shows that 


d(A,0)<d(A, B)+ d(B, 0), 


that is, 


p*(A) < d(A, B) + p*(B). 


Since jt*(B) ts finite, it follows that 


(31) 
(32) 
(33) 
(34) 


(35) 


(36) 


u*(A) — p*(B) < d(A, B). 


Proof of Theorem 11.10 Suppose 4 €W,(u), Be DMi-(u). Choose {A,}, 
{B,} such that A, Ee ¢. B,E€é, A, 7A, B, > B. Then (29) and (30) show 
that 


A,V B,7AwU B, 
A, 1 B,7 A B, 
A, — B, 7A — B, 
ae p* (hg) >t), 
and p*(A) < + o since d(A,, A) > 0. By (31) and (33), N-(u) is a ring. 
By (7), 
W(A,) + W(B,) = WA, V B,) + (A, 0 B,). 
Letting # — 0, we obtain, by (34) and Theorem 11.8(a), 
p*(A) + *(B) = p*(A UB) + (A 9B). 


if An’ = O-thens*(A 7 B=. 

It follows that y* is additive on Wi,-(y). 

Now let A € Wu). Then 4 can be represented as the union of a 
countable collection of disjoint sets of Di-(u). For if A= PAL with 
A; € Wi-(u), write A, = A;, and 


ae Oooo me ro) wee) Geet 54... .). 
Then 


is the required representation. By (19) 


w(A) < ps u*(A,). 
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On the other hand, A > A, U-': UA,; and by the additivity of 
u* on M(t) we obtain 


(37) p(A) 2 w*(A, UU A,) = B(A,) + + + (AY). 
Equations (36) and (37) imply 


(38) una) = ¥ "(A 


Suppose p*(A) is finite. Put B, = A, U-:’ U A,. Then (38) shows 
that 


dA, B) =n" UY AD= > HA) 40 


i=n+l1 i=n+1 


as noo. Hence B,- 4A; and since B, € W,(y), it is easily seen that 
A € Dt-(u). 
We have thus shown that A € Mt,-(y) if A € M() and ye*(A) < + ©. 
It is now clear that p* is countably additive on Nit). For if 


vv 


where {A,} 1s a sequence of disjoint sets of Mt(j1), we have shown that (38) 
holds if *(A,) < + 00 for every n, and in the other case (38) is trivial. 

Finally, we have to show that (1) is a o-ring. If A, €e Wu), 2 = |, 
2, 3,..., it is clear that () A, € Dt(u) (Theorem 2.12). Suppose A € D(ys), 
Be My), and 


A= () A. B= UB 
where A,, B, € Mt-(u). Then the identity 
A, B= U (A, 0 B;) 
shows that A, 0 B € Di(u); and since 


u*(A, OB) s u*(A,) < + ©, 


A, Be (yu). Hence A,— BeM,(u), and A—BeEeDM(p) since 
A—B=\)m, (A, — B). 


We now replace p*(A) by yu(A) if A € Iu). Thus yp, originally only de- 
fined on &, is extended to a countably additive set function on the o-ring 
Mu). This extended set function is called a measure. The special case py =m 
is called the Lebesgue measure on | a 


11.11 


(39) 


(40) 
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Remarks 


(a) If A is open, then A € Ww). For every open set in R? is the union 
of a countable collection of open intervals. To see this. it is sufficient to 
construct a countable base whose members are open intervals. 

By taking complements, it follows that every closed set is in t(y). 
(6) If A € Wu) and e > 0, there exist sets F and G such that 


FCoahe G, 


F is closed, G is open, and 
u(G — A) <eé, W(A — F) <e. 


The first inequality holds since y* was defined by means of coverings 
by open elementary sets. The second inequality then follows by taking 
complements. 

(c) We say that £ is a Borel set if E can be obtained by a countable 
number of operations, starting from open sets, each operation consisting 
in taking unions, intersections, or complements. The collection # of all 
Borel sets in R? is a o-ring; in fact, it is the smallest o-ring which contains 
all open sets. By Remark (a), EF € Wu) if Fe &. 

(d) If A € Wp). there exist Borel sets F and G such that FC ACG, 


and 


1(G — A) = (A — F) = 0. 


This follows from (6) if we take ¢ = I/n and let n > o0. 

Since A = F U (A — F), we see that every A € Wu) is the union of a 
Borel set and a set of measure zero. 

The Borel sets are 4u-measurable for every up. But the sets of measure 
zero [that is, the sets E for which p*(E) = 0] may be different for different 
ps. 

(e) For every p, the sets of measure zero form a o-ring. 

(f) In case of the Lebesgue measure, every countable set has measure 
zero. But there are uncountabie (in fact, perfect) sets of measure zero. 
The Cantor set may be taken as an example: Using the notation of Sec. 
2.44, it is easily seen that 


me)= GY (wel, ?2,3,...); 


and since P = () E,, P< E, for every n, so that m(P) = 0. 
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MEASURE SPACES 


11.12 Definition Suppose Y¥ is a set, not necessarily a subset of a euclidean 
space, or indeed of any metric space. YX is said to be a measure space if there 
exists a o-ring M of subsets of X (which are called measurable sets) and a non- 
negative countably additive set function p (which is called a measure), defined 
on Mt. 

If, in addition, X e€ M, then X is said to be a measurable space. 

For instance, we can take XY = R?, IM the collection of all Lebesgue- 
measurable subsets of R’, and » Lebesgue measure. 

Or, let X be the set of all positive integers, Wt the collection of all subsets 
of X, and p(E£) the number of elements of E. 

Another example is provided by probability theory, where events may be 
considered as sets, and the probability of the occurrence of events is an additive 
(or countably additive) set function. 

In the following sections we shall always deal with measurable spaces. 
It should be emphasized that the integration theory which we shall soon discuss 
would not become simpler in any respect if we sacrificed the generality we have 
now attained and restricted ourselves to Lebesgue measure. say, on an interval 
of the real line. In fact, the essential features of the theory are brought out 
with much greater clarity in the more general situation, where it is seen that 
everything depends only on the countable additivity of ss on a o-ring. 

It will be convenient to introduce the notation 


(41) {x|P} 


for the set of all elements x which have the property P. 


MEASURABLE FUNCTIONS 


11.13 Definition Let f be a function defined on the measurable space Y, with 
values in the extended real number system. The function / is said to be measur- 
able if the set 


(42) {x|f(x) > a} 


is measurable for every real a. 


11.14 Example If X = R? and Mt=M(u) as defined in Definition 11.9, 
every continuous f is measurable, since then (42) is an open set. 
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11.15 Theorem Each of the following four conditions implies the other three: 


(43) {x| f(x) > a} is measurable for every real a. 
(44) {x| f(x) => a} is measurable for every real a. 
(45) {x| f(x) < a} is measurable for every real a. 
(46) {x| f(x) < a} is measurable for every real a. 


Proof The relations 


8 


(xlsx) > a) = (7) [rife >a], 


n= 


{x| f(x) < a} = X — {x|f(x) = a}, 
{xfer =a} = () [Lf <a+-], 


{x| f(x) > a} = X — {x| f(x) < a} 
show successively that (43) implies (44), (44) implies (45), (45) implies 
(46), and (46) implies (43). 


Hence any of these conditions may be used instead of (42) to define 
measurability. 


11.16 Theorem Jf f is measurable, then | f| is measurable. 


Proof 
{x| |f(x)| <a} = {x| f(x) < a} 9 {x| f(x) > — ah. 


11.17 Theorem Let {/,} be a sequence of measurable functions. For x € X, put 


g(x) = sup f(x) (PBA, 35.44, 
h(x) = lim sup f,(x). 


Then g and h are measurable. 
The same is of course true of the inf and lim inf. 


Proof 


(x]9(@) > a} =) (If) > a. 
h(x) = inf gy), 
where g,,(x) = sup f,(x) (n > m). 
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Corollaries 


(a) Iffandg are measurable, then max (f, g) and min (f, g) are measurable. 


FF 
(47) f* =max(f,0), f~ = —min(/f, 9), 
it follows, in particular, that f* and f~ are measurable. 


(b) The limit of a convergent sequence of measurable functions is measurable. 


11.18 Theorem Let f and g be measurable real-valued functions defined on X, 
let F be real and continuous on R?, and put 


h(x) = F(/(x), g(x) (xe X). 


Then h is measurable. 
In particular, f + g and fg are measurable. 


Proof Let 
G, = {(u, v)| F(u, v) > a}. 


Then G, is an open subset of R*, and we can write 


G.= Uh 
where {J,} is a sequence of open intervals: 
L.= (@ OD) lagu < 6, c, < vd). 
Since 
{x|a, < f(x) < by} = {x|f(x) > an} 0 x| f(x) < 5,} 
is measurable, it follows that the set 
{x| (f(x), g(x) € Tn} = {xan < f(x) < b,} 7 (xe, < G(x) < dy} 


is measurable. Hence the same is true of 
{x| h(x) > a} = {x|(f(x), g(x)) € G,} 
= YJ GI(/0, a0) € hy. 


Summing up, we may say that all ordinary operations of analysis, includ- 
ing limit operations, when applied to measurable functions, lead to measurable 
functions; in other words, all functions that are ordinarily met with are measur- 
able. 

That this is, however, only a rough statement is shown by the following 
example (based on Lebesgue measure, on the real line): If A(x) = f(g(x)), where 
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Jf is measurable and g is continuous, then A is not necessarily measurable. 
(For the details, we refer to McShane, page 241.) 

The reader may have noticed that measure has not been mentioned in 
our discussion of measurable functions. In fact, the class of measurable func- 
tions on X depends only on the o-ring IR (using the notation of Definition 11.12). 
For instance, we may speak of Bore/l-measurable functions on R?, that is, of 
function f for which 


{x| f(x) > a} 


is always a Borel set, without reference to any particular measure. 


SIMPLE FUNCTIONS 


11.19 Definition Let s be a real-valued function defined on X. If the range 
of s is finite, we say that s is a simple function. 
Let E — X, and put 


a ¥ (x € E), 
K, is called the characteristic function of E. 
Suppose the range of s consists of the distinct numbers c,,...,¢,. Let 


E;, = SAW) =; =) ee.) 3 


Then 
n 
(49) i=) Ci Keay, 
n=1 
that is, every simple function is a finite linear combination of characteristic 
functions. It is clear that sis measurable if and only if the sets E,,..., E, are 
measurable. 


It is of interest that every function can be approximated by simple 
functions: 


11.20 Theorem Ler f be a real function on X. There exisis a sequence {5,} of 
simple functions such that s,(x) + f(x) as n — 00, for every x € X. If f is measur- 
able, {s,} may be chosen to be a sequence of measurable functions. If f = 9, {sy} 
may be chosen to be a monotonically increasing sequence. 


Proof If f= 0, define 
i- 1 
z 


Ey = {x < fix) <5 ; F, = {x|f(x) 2 7} 
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fonmm= 1, 2,.3;...,f=dy2eeage ie 
m2” jp — | 
(50) = 2. a K, , + nKr,. 


In the general case, let f= f* —f~, and apply the preceding construction 
to f* andito/~. 

It may be noted that the sequence {s,} given by (50) converges 
uniformly to f if fis bounded. 


INTEGRATION 


We shall define integration on a measurable space X, in which Mi is the o-ring 
of measurable sets, and p is the measure. The reader who wishes to visualize 
a more concrete situation may think of X as the real line, or an interval, and of 
pas the Lebesgue measure m. 


11.21 Definition Suppose 
(51) s(x)= ) c;Ke(x) Ge X,c,>0) 
i=1 


is measurable, and suppose E e€ Mt. We define 

(52) Is) = Y cim(E 0 E). 
If f is measurable and nonnegative, we define 

(53) [fd = sup Le(s), 


where the sup is taken over all measurable simple functions s such thatO <5 </f,. 
The left member of (53) is called the Lebesgue integral of f, with respect 
to the measure p, over the set E. It should be noted that the integral may have 
the value +00. 
It is easily verified that 


(54) " s dp = I,(s) 


for every nonnegative simple measurable function s. 


11.22 Definition Let f be measurable, and consider the two integrals 


55 * dn, i. 
(55) [fod ff aw, 
where f* and f~ are defined as in (47). 
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If at least one of the integrals (55) is finite, we define 
56 du = * du — ~ du. 
(56) J fdu= J f* du fodu 

If both integrals in (55) are finite, then (56) is finite, and we say that fis 
integrable (or summable) on E in the Lebesgue sense, with respect to 1; we write 
fe L(u) on E. If ph =m, the usual notation is: fe # on E. 

This terminology may be a little confusing: If (S56) is +00 or —oo, then 
the integral of f over E is defined, although / is not integrable in the above 
sense of the word; fis integrable on E only if its integral over E is finite. 


We shall be mainly interested in integrable functions, although in some 
cases it is desirable to deal with the more general situation. 


11.23. Remarks The following properties are evident: 
(a) If f is measurable and bounded on E, and if p(E) < +00, then 


fe Mipyweon E. 
(6) Ifa<sf(x) <5 for x Ee £, and p(E£) < +00, then 
au(E) < ip fdp < bp(E). 
(c) If fand g € P(u) on E, and if f(x) < g(x) for x € E, then 
[ fdus [ 9 du. 
iE fg 
(d) If fe L(u) on E, then cfe L(u) on E, for every finite constant c, and 
| of du =c | Sf du. 
3, E 
(e) If #(E) =0, and fis measurable, then 
| fdp =0. 
iE 
() Iffe Liu) on E, AEM, and AcE, then fe L(y) on A. 
11.24 Theorem 


(a) Suppose f is measurable and nonnegative on X. For A €M, define 


(57) (A) = { St 
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(58) 


(59) 


(60) 


Then @ is countably additive on IM. 
(b) The same conclusion holds if f € Zw) on X. 


Proof It is clear that (b) follows from (a) if we write f=f* —f~ and 


apply (a) tof* andtof~. 
To prove (a), we have to show that 


$(A) = d. (An) 
if Age WM (n= 1,2, 3, ..). Apr Ab dor. itymandh Acalyhf Ay. 


If f is a characteristic function, then the countable additivity of ¢ is 
precisely the same as the countable additivity of yz, since 


p Kp dp =w(An E). 


If f is simple, then f is of the form (51), and the conclusion again 
holds. 

In the general case, we have, for every measurable simple function s 
such thatO <5 </f, 


J sdu=¥ fo sdu<¥ $4). 
A n=1°An n=1 


Therefore, by (53), 


H(A) < D $(A,). 
Now if @(A,) = +00 for some n, (58) is trivial, since @(A) > d(A,). 
Suppose $(A,,) < +00 for every n. 


Given €>0, we can choose a measurable function s such that 
0 <s</, and such that 


f sdez] fdu-e, J sme] Sdu—e. 


Hence 


H(A, U A) 2 | 


A; VA? 


sdu = | s du + { s dp > o(A,) + G(A2) — 28, 
A, A2 
so that 


P(A; UV A2)# = H(A,) + P(AQ). 
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It follows that we have, for every 7, 
(61) P(A, U-- UA,) > G(A;) +--+ G(A,). 
Since A > A, U-:: UA,, (61) implies 


(62) WA) = Y 44,), 
and (58) follows from (59) and (62). 


Corollary If A eM, Bc A, and (A — B) =0, then 


J fu = [ fdu. 


Since A = B U(A — B), this follows from Remark 1|1.23(e). 


11.25. Remarks The preceding corollary shows that sets of measure zero are 
negligible in integration. 
Let us write f~ g on E if the set 


{x| f(x) # G(xX)} OE 


has measure zero. 

Then f~ f/f; f~ g implies g ~ f; and f~g, g ~h implies f~ h. That is, 
the relation ~ is an equivalence relation. 

If f~ g on E, we clearly have 


[ fu - i, g dp, 


provided the integrals exist, for every measurable subset A of E. 

If a property P holds for every x e E — A, and if 4A) = 0, it is customary 
to say that P holds for almost all x € E, or that P holds almost everywhere on 
E. (This concept of “‘almost everywhere’ depends of course on the particular 
measure under consideration. In the literature, unless something is said to the 
contrary, it usually refers to Lebesgue measure.) 

If fe L(y) on E£, it is clear that f(x) must be finite almost everywhere on E. 
In most cases we therefore do not lose any generality if we assume the given 
functions to be finite-valued from the outset. 


11.26 Theorem /f fe L(y) on E, then |f| € L(y) on E, and 


(63) fsa <|. \f| du. 


318 PRINCIPLES OF MATHEMATICAL ANALYSIS 


Proof Write E = AWB, where f(x)>0 on A and f(x) <0 on B. 
By Theorem 11.24, 


[flidu=J ifldu+f ifldu= Jf pt dut | fo du< +00, 
so that |f| € F(u). Since f < |f| and —f< |f]|, we see that 
| fdus [Vide - | fu < . fl du, 
and (63) follows. 


Since the integrability of f implies that of |f|, the Lebesgue integral is 
often called an absolutely convergent integral. It is of course possible to define 
nonabsolutely convergent integrals, and in the treatment of some problems it is 
essential to do so. But these integrals lack some of the most useful properties 
of the Lebesgue integral and play a somewhat less important role in analysis. 


11.27 Theorem Suppose f is measurable on E, |\f| <g, and g€ L(p) on E. 
Then f € L(p) on E. 


Proof We have f* <gandf” <g. 


11.28 Lebesgue’s monotone convergence theorem Suppose E eM. Let {f,} be 
a sequence of measurable functions such that 


(64) 0.</ @Oe=4@e =<": (x € £). 
Let f be defined by 
(65) SOY Fey Wwe) 


asn—oo. Then 


(66) [fade] fdu (n+ 00). 


Proof By (64) it is clear that, as n > o0, 


(67) | f,dpa 
E 
for some «; and since {f, < [f, we have 


(68) a< I. f dp. 


(69) 


(70) 


(71) 


(72) 
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Choose c such that 0 <c <1, and let s be a simple measurable 
function such thatO<s</f. Put 


E, = {x|f,(x) = cs(x)} Gr", 2. 3,.....): 
By (64), BE, < B, © £, € --: ; and by (65), 


For every 7, 
[fade =f Sap ze] sdu 


We let n > co in (70). Since the integral is a countably additive set function 
(Theorem 11.24), (69) shows that we may apply Theorem 11.3 to the last 
integral in (70), and we obtain 


Cll Sidi, 
[<4 
Letting c > 1, we see that 
a>] sdn, 
I< 
and (53) implies 
a> du. 
i yu 


The theorem follows from (67), (68), and (72). 


11.29 Theorem Suppose f=f, +f, where f,€ Lu) on E (i =1, 2). Then 
fe L(y) on E, and 


(73) 


i fdp = [fi du + ik fr du. 


Proof First, suppose f, > 0, f, >0. If f, and /, are simple, (73) follows 
trivially from (52) and (54). Otherwise, choose monotonically increasing 
sequences {s/}, {s’} of nonnegative measurable simple functions which 
converge to fi, f,. Theorem 11.20 shows that this is possible. Put 
5, = 5, +5,. Then 


iE du = I Ss, du + f. s’ dp, 


and (73) follows if we let n + co and appeal to Theorem 11.28. 
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Next, suppose /, > 0,f, <0. Put 
A ={x|f(x) 20}, B= {x| f(x) < 0}. 


Then f, f,, and —f, are nonnegative on A. Hence 


(74) [ faw=f fans | (fddu=f fdu-J fr dn 


Similarly, —f, f;, and —/f, are nonnegative on B, so that 


[ (fdu=J fidu+ | (Daw 
or 
(75) [ fidu=| fdu— | fadu 


and (73) follows if we add (74) and (75). 

In the general case, E can be decomposed into four sets E; on each 
of which f/,(x) and /,(x) are of constant sign. The two cases we have proved 
so far imply 


[ fdu=| fdu+{ fede (i =1,2,3,4), 
Ej Ej Ei 
and (73) follows by adding these four equations. 
We are now in a position to reformulate Theorem 11.28 for series. 


11.30 Theorem Suppose Ee Mt. If{f,} is a sequence of nonnegative measurable 
functions and 


(76) f@)=S fe) (eB), 


then 
[ fae=d | foaw 
ja n=1°E 
Proof The partial sums of (76) form a monotonically increasing sequence. 


11.31 Fatou’s theorem Suppose Ee M. If (f,} is a sequence of nonnegative 
measurable functions and 
S(X)= lithant 7) (x € E), 
then 
(77) { fdu <limint [ f, dy. 
E 


1? o sa) 
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Strict Inequality may hold tn (77). An example is given in Exercise 5. 
Proof Forn=1,2,3,... and xe, put 
GAX) = inf f(x) (i >n). 


Then g, is measurable on E, and 


(78) O<9 (x) <9(r)<°°°, 
(79) GX) S Sal), 
(80) GAx) f(x) (n-+ 0). 


By (78). (80), and Theorem 11.28, 
8 | a?) ees dit, 
an Fondue =f sam 
so that (77) follows from (79) and (81). 


11.32 Lebesgue’s dominated convergence theorem Suppose Ee. Let {f,} be 
a sequence of measurable functions such that 


(82) yay) (amen) 
asn—oo. If there exists a function g € Lp) on E, such that 
(83) |fiadexe) |) <eaghee) Ole. Pres. oceaa E Bh), 
then 

(84) lim | fut = " fdu. 


Because of (83). {f,} is said to be dominated by g, and we talk about 
dominated convergence. By Remark 11.25, the conclusion is the same if (82) 
holds almost everywhere on E. 


Proof First. (83) and Theorem 11.27 imply that f, € 2(u) and fe A(t) 
on E. 
Since f/, + g > 0, Fatou’s theorem shows that 


{ (f +g) du < lim inf [ (f, +g) de. 
E neve: = SE 
or 


(85) [fu < lim int {Sn du. 
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Since g — f, > 0, we see similarly that 


[ (-S) du < tim int [ (9 - f,) du, 
E n> E 
so that 


noo 


-| fdy.< tim int | ~ { fed, 
IE E 
which ts the same as 
(86) { f dp > lim sup f dp. 
E noo E 


The existence of the limit in (84) and the equality asserted by (84) 
now follow from (85) and (86). 


Corollary Jf uw(E) < +0, {f,} is uniformly bounded on E, and f,(x) + f(x) on E, 
then (84) holds. 


A uniformly bounded convergent sequence is often said to be boundedly 
convergent. 


COMPARISON WITH THE RIEMANN INTEGRAL 


Our next theorem will show that every function which is Riemann-integrable 
on an interval is also Lebesgue-integrable, and that Riemann-integrable func- 
tions are subject to rather stringent continuity conditions. Quite apart from the 
fact that the Lebesgue theory therefore enables us to integrate a much larger 
class of functions, its greatest advantage lies perhaps in the ease with which 
many limit operations can be handled; from this point of view, Lebesgue’s 
convergence theorems may well be regarded as the core of the Lebesgue theory. 

One of the difficulties which is encountered in the Riemann theory is 
that limits of Riemann-integrable functions (or even continuous functions) 
may fail to be Riemann-integrable. This difficulty is now almost eliminated, 
since limits of measurable functions are always measurable. 

Let the measure space X be the interval [a, b] of the real line, with p = m 
(the Lebesgue measure), and Wt the family of Lebesgue-measurable subsets 
of [a, bj. Instead of 


[fem 


it is customary to use the familiar notation 


f fax 
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for the Lebesgue integral of f over [a,b]. To distinguish Riemann integrals 
from Lebesgue integrals, we shall now denote the former by 


R [ fax 


11.33 Theorem 


(87) 


(88) 


(89) 


(90) 


(91) 


(92) 


(a) If fe on {a, bj, then f € F on [a, b], and 
b b 
[ fax=a[ fax. 
(b) Suppose f is bounded on {a, b). Then f € & on {a, b] if and only if f is 
continuous almost everywhere on [a, b}. 


Proof Suppose fis bounded. By Definition 6.1 and Theorem 6.4 there 
is a sequence {P,} of partitions of [a,b], such that P,,, is a refinement 
of P,, such that the distance between adjacent points of P, is less than 
1/k, and such that 


lim L(P,,f) = { fdx, lim U(P,,f)=2 | fax. 
k>@ & k> ma 
(In this proof, all integrals are taken over [a, b].) 
MPS ieaexy . 07%) ithe xy = a, x, = by define 
U,(a) = L,(a) = f(a); 
put U,@) = Mame! Lge) =i, for x,., < x =x;,1 sish, using the 
notation introduced in Definition 6.1. Then 
L(P,,f)=[lidx, — U(P,.f) = [Ux dx, 
and 
Lies La@) see -af(x) <--> Ss, U ~*~) < U_@) 
for all x € [a, b], since P,,, refines P,. By (90), there exist 
EXx) =4im L(x), U(x) = lim U,(x). 
k->o@ k->o@ 


Observe that L and U are bounded measurable functions on [a, 5}, 
that 


L(x) = f(x) U(x) (a<x <b), 
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(93) 


(94) 


(95) 


and that 


[Ldx = 2 | fadx, [udx=a| fax, 


by (88), (90), and the monotone convergence theorem. 

So far, nothing has been assumed about f except that fis a bounded 
real function on [a, 5}. 

To complete the proof, note that fe # if and only if its upper and 
lower Riemann integrals are equal, hence if and only if 


[Lax = [Udx; 


since L < U, (94) happens if and only if L(x) = U(x) for almost: all 
x € [a, b] (Exercise 1). 
In that case, (92) implies that 


L(x) = f(x) = U(x) 


almost everywhere on [a, b], so that f is measurable, and (87) follows 
from (93) and (95). 

Furthermore, if x belongs to no P,, it is quite easy to see that U(x) = 
L(x) ifand only if fis continuous at x. Since the union of the sets P, is count- 
able, its measure is 0, and we conclude that fis continuous almost every- 
where on [a,b] if and only if L(x) = U(x) almost everywhere, hence 
(as we saw above) if and only if fe &. 

This completes the proof. 


The familiar connection between integration and differentiation is to a 


large degree carried over into the Lebesgue theory. If fe Y on [a, b], and 


(96) 


F(x) =f fat (a<x <b), 


then F’(x) = f(x) almost everywhere on [a, 5]. 


Conversely, if F is differentiable at every point of [a, b] (‘‘almost every- 


where”’ is not good enough here!) and if F’ e # on [a, b], then 


F(x) — F(a) = i F'(t) @ax <b). 


For the proofs of these two theorems, we refer the reader to any of the 


works on integration cited in the Bibliography. 


THE LEBESGUE THEORY 325 


INTEGRATION OF COMPLEX FUNCTIONS 


Suppose f is a complex-valued function defined on a measure space Y, and 
f =u + iv, where u and v are real. We say that f is measurable if and only if 
both u and v are measurable. 

It is easy to verify that sums and products of complex measurable functions 


are again measurable. Since 
If| = (u? + v7), 


Theorem 11.18 shows that |f| is measurable for every complex measurable /. 

Suppose p is a measure on X, E is a measurable subset of X, and fis a 
complex function on X. We say that fe Y(u) on E provided that fis measurable 
and 


(97) [ Il du< +0, 
E 
and we define 
a= du+ijovd 
[J he fu mi if m 


if (97) holds. Since |u| < |f|, |e| < |f|, and |f| < |u| + Jol, it is clear that 
(97) holds if and only if ue A(z) and v € H(p) on E. 

Theorems 11.23(a), (d), (e), (/), 11.24(6), 11.26, 11.27, 11.29, and 11.32 
can now be extended to Lebesgue integrals of complex functions. The proofs 
are quite straightforward. That of Theorem 11.26 is the only one that offers 
anything of interest: 

If fe L(y) on E, there is a complex number c, |c| = 1, such that 


c[ Sdu>0. 
E 
Put g =cf=u+ iv, uand v real. Then 
alee hel 6g ote = [ ici 
j fa c | fan [9d J u ju 


The third of the above equalities holds since the preceding ones show that 
fg dp is real. 


FUNCTIONS OF CLASS 2? 


As an application of the Lebesgue theory, we shall now extend the Parseval 
theorem (which we proved only for Riemann-integrable functions in Chap. 8) 
and prove the Riesz-Fischer theorem for orthonormal sets of functions. 
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11.34 Definition Let XY be a measurable space. We say that a complex 
function f € £?(u) on X if f is measurable and if 


| fl? du < + 0. 
Xx 


If yw is Lebesgue measure, we say fe Y”. For fe Y7(u) (we shall omit the 
phrase “‘on X” from now on) we define 


fz 
isi={f fl? aul 
and call ||f|| the Y?() norm of f. 


11.35 Theorem Suppose fe £?(u) andge L?(u). Then fg € L(t), and 


(98) [ Lfal du < If ligt. 


This is the Schwarz inequality, which we have already encountered for 
series and for Riemann integrals. It follows from the inequality 


O<f (fl + Algl)? du =Ifl? +22) [fol du + Higl?, 
xX X 


which holds for every real /. 


11.36 Theorem If fe Y?(u) andg € F?(n), then f+9 € L7(W), and 


f+ gil < fll + llgi. 
Proof The Schwarz inequality shows that 


If + gl? =f Uf? + [fo+ Vio | lol? 
<I? + QF gl + Wall? 
= (fi + gil)’. 


11.37 Remark If we define the distance between two functions f and g in 
L?(u) to be ||f — gl], we see that the conditions of Definition 2.15 are satisfied, 
except for the fact that ||f—g\| =0 does not imply that f(x) = g(x) for all x, 
but only for almost all x. Thus, if we identify functions which differ only on a 
set of measure zero, 7() is a metric space. 

We now consider ¥Y? on an interval of the real line, with respect to 
Lebesgue measure. 


11.38 Theorem The continuous functions form a dense subset of L? on {a, 6). 
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More explicitly, this means that for anv fe #? on [a, db}, and any « > 0, 
there is a function g, continuous on [a, 5], such that 


b 1/2 
If —gll ={f (f- gy as| < &. 
Proof We shall say that f is approximated in Y? by a sequence {g,} if 


If — gall 70 as n > oo. 
Let A be a closed subset of [a, 6], and K, its characteristic function. 


Put 
(x)=inf|x-—y| (yeA) 
and 
] 
= —____. =), 2, 4 oa): 
GAX) ee (n ) 


Then g, is continuous on [a, bj, g,(x)=1 on A, and g,(x) 0 on B, 
where B = [a, b] — A. Hence 


1/2 
W9n — Kall = [| 98 as| +0 


by Theorem 11.32. Thus characteristic functions of closed sets can be 
approximated in ¥Y? by continuous functions. 

By (39) the same is true for the characteristic function of any 
measurable set, and hence also for simple measurable functions. 

If f>0 and fe #’, let {s,} be a monotonically increasing sequence 
of simple nonnegative measurable functions such that s,(x) >/(x). 
Since |f—s,|? <f’, Theorem 11.32 shows that || f— s,|| —0. 

The general case follows. 


11.39 Definition We say that a sequence of complex functions {@,} is an 
orthonormal set of functions on a measurable space X if 


I, bnPm AL = 1 - _ 


In particular, we must have ¢, € #7(u). If fe L?(u) and if 
a | die HN 203.0 
x 


we write 


as in Definition 8.10. 
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The definition of a trigonometric Fourier series is extended in the same 
way to ¥? (or even to #) on [—2z, 2]. Theorems 8.11 and 8.12 (the Bessel 
inequality) hold for any fe #7(u). The proofs are the same, word for word. 

We can now prove the Parseval theorem. 


11.40 Theorem Suppose 


(99) fe)~ Soe, 
where fe LZ? on[—n, n]. Let s, be the nth partial sum of (99). Then 
(100) lim If ~ sl = 0, 
(101) E lel? =f fl? ax 
ay Pin 


Proof Let ¢>0 be given. By Theorem 11.38, there is a continuous 
function g such that 


E 
ee <i 
If-gl <3 
Moreover, it is easy to see that we can arrange it so that g(x) = g(—7). 


Then g can be extended to a periodic continuous function. By Theorem 
8.16, there is a trigonometric polynomial 7, of degree N, say, such that 


€ 
—T\|| <-. 
lg | 5 


Hence, by Theorem 8.11 (extended to ¥?), n > N implies 
ls. ~fll < IT -Sll <e, 


and (100) follows. Equation (101) is deduced from (100) as in the proof of 
Theorem 8.16. 


Corollary If fe Y? on [—n, x], and if 
[fe dx=0  (n=0, £1, 42,..., 
then |\f\| = 0. 


Thus if two functions in Y* have the same Fourier series, they differ at 
most on a set of measure zero. 
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11.41 Definition Let f and f,€ #’(u) (1 = 1,2,3,...). We say that {f} 
converges to fin Y7(q) if |i, —fl| +0. We say that {f,} is a Cauchy sequence 
in £7(u) if for every ¢ > O there is an integer N such that n > N, m > N implies 


if, =Sill = @. 


11.42 Theorem /f (/,} is a Cauchy sequence in LY*(u), then there exists a 
function f € L(t) such that {f,} converges to f in L?(). 


This says, in other words, that Y7(,1) is a complete metric space. 
Proof Since (/,} is a Cauchy sequence, we can find a sequence {n,}, 


k= ), 2.3... mem that 


(2 an 


die I 
b Sng = fel is > 


Choose a function g € ¥7(j). By the Schwarz inequality. 
| | a >. & Som + ) | dt = Ng 
“ay We 


Hence 


(102) 


= 
D a 


L 96S. — Sine DI] de < lig. 
xX 


i 
By Theorem 11.30, we may interchange the summation and integration in 
(102). It follows that 


(103) JAI] nl) Sup ()] < + 0 
almost everywhere on X. Therefore 
(104) Y fan si) —fal2] < + 20 
k=1 


almost everywhere on X. For if the series in (104) were divergent on a 
set E of positive measure, we could take g(x) to be nonzero on a subset of 
E of positive measure, thus obtaining a contradiction to (103). 

Since the Ath partial sum of the series 


y Pin) — Sn), 


which converges almost everywhere on X, 1s 


Wiss (x) — f,, 0), 
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we see that the equation 
f(x) a is Suh) 


defines f(x) for almost all x € X, and it does not matter how we define 
f(x) at the remaining points of X. 

We shall now show that this function f has the desired properties. 
Let ¢ > 0 bé given, and choose WN as indicated in Definition 11.41. If 
n, > N, Fatou’s theorem shows that | 


IF —Sngll < lim inf If, —Snull S €- 


Thus f—f,, € #7(u), and since f=(f—f,,) +/a,, we see that fe L?(). 
Also, since € is arbitrary, 


lim If — full = 0. 
Finally, the inequality 
(105) FMS — Snell +llfe, — Fl 


shows that {f,} converges to f in #?(u); for if we take n and n, large 
enough, each of the two terms on the right of (105) can be made arbi- 
trarily small. 


11.43 The Riesz-Fischer theorem Let {¢,} be orthonormal on X. Suppose 


L\c,|7 converges, and put s, = c,d, +°*: + ¢,p,. Then there exists a function 
fe L’ (yu) such that {s,} converges to f in L?(), and such that 


Ms 


jr CnPn i 


n 


Proof Forn> m, 


IlSn — Smil” = [Cm+s 1? + °° + feql?, 


so that {s,} is a Cauchy sequence in ¥?(u). By Theorem 11.42, there is 
a function f € Y?(u) such that 


lim If — s,l| =0. 


Now, forn>k, 


| du — c= [ du — \ 59 A, 
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so that 


[Pade a 


SWS — Sall > Pall + IS sul. 
Letting n — 00, we see that 
@ =| fe 42433. 
xX 


and the proof is complete. 


11.44 Definition An orthonormal set {¢,} is said to be complete if, for 
fe L?(p), the equations 


[ fondu=0 (n=1,2,3,...) 
X 


imply that ||f|| = 0. 

In the Corollary to Theorem 11.40 we deduced the completeness of the 
trigonometric system from the Parseval equation (101). Conversely, the Parseval 
equation holds for every complete orthonormal set: 


11.45 Theorem Ler {¢,} be a complete orthonormal set. If f€ L?(u) and if 


(106) f~) cbs. 

then 

(107) [ Ul? du = ¥ Leal? 
xX n=1 


Proof By the Bessel inequality, 2|c,|* converges. Putting 
Sn a C19 aa ite, 5 


the Riesz-Fischer theorem shows that there is a function g € Y?(y) such 
that 


(108) — 


and such that ||g —s,|| +0. Hence |ls,|| > {|g||. Since 
IIsqll? = lou ae | a ee 


we have 


(109) fj tal? du => lenl? 
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Now (106), (108), and the completeness of {¢,} show that || f — g|| = 0, 
so that (109) implies (107). 


Combining Theorems 11.43 and 11.45, we arrive at the very interesting 
conclusion that every complete orthonormal set induces a I-1 correspondence 
between the functions fe #?(u) (identifying those which are equal almost 
everywhere) on the one hand and the sequences {c,} for which Z|c,|? converges, 
on the other. The representation 


f~ cube 


together with the Parseval equation, shows that #?(y) may be regarded as an 
infinite-dimensional euclidean space (the so-called “Hilbert space’’), in which 
the point f has coordinates c,, and the functions ¢, are the coordinate vectors. 


EXERCISES 


1. If f >0 and fz f dp = 0, prove that f(x) = 0 almost everywhere on E. Hint: Let E, 
be the subset of E on which f(x) > 1/n. Write A = UE,. Then p(A) = Oif and only 
if u(E,) = 0 for every n. 


2. If [4 fdw = 0 for every measurable subset A of a measurable set E, then f(x) == 0 
almost everywhere on E. 


3. If {f,} is a sequence of measurable functions, prove that the set of points x at 
which { f,(x)} converges is measurable. 


4. If fe L(y) on E and g is bounded and measurable on E, then fg ¢ Y(u) on E. 
5: Put 


_ fo @ = x =), 
g(x) | @ <2 li), 
falx) = g(x) (O<x <1), 
fasiixy=gl—x) O<x< 1). 
Show that 
lim inf f,(x) = 0 @O<x <1), 
but 


[, fC de = 4. 


{Compare with (77).] 
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6. Let 


foe (|x| <n), 


ozl= 


(|x| >n). 


Then /,(x) ~ 0 uniformly on R', but 
{- weet 3 (re t_,23, .... 


(We write {®,, in place of Jr,.) Thus uniform convergence does not imply domi- 
nated convergence in the sense of Theorem 11.32. However, on sets of finite 
measure, uniformly convergent sequences of bounded functions do satisfy Theo- 
rem 11.32. 

7. Find a necessary and sufficient condition that fe A(«) on [a,b]. Hint: Consider 
Example 11.6(6) and Theorem 11.33. 

8. If fe B on [a, bd) and if F(x) = fi (1) dt, prove that F’(x) = f(x) almost every- 
where on [a, 5]. 

9. Prove that the function F given by (96) is continuous on [a, 5). 

10. If p(X¥)< +a and fe H(z) on X, prove that fe A(u) on X. If 


HX)= +a, 


this is false. For instance, if 


l 
MO) = Teme 


then fe FY? on R', but f¢ F on R'. 
11. If f,g € Lip) on X, define the distance between f and g by 
i ‘a | 
i If— gi dp. 


Prove that Fj) is a complete metric space. 

12. Suppose 
Geo. Ales 1 AO 10's y< 1, 
(6) for fixed x, f(x, y) is a continuous function of », 
(c) for fixed y, f(x, y) is a continuous function of x. 
Put 


Gx) = [. f(x y)dy (OS x= 1). 


Is g continuous? 
13. Consider the functions 


fab) = Sin 0x (= AD, Be. ccc, ~P BREW 
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14. 


6. 


16. 


Wy. 


18. 


as points of Y?. Prove that the set of these points is closed and bounded, but 


not compact. 
Prove that a complex function f is measurable if and only if f~'(V) is measurable 


for every open set V in the plane. 
Let & be the ring of all elementary subsets of (0, 1]. If 0 <a<b< 1, define 


$([a, 6) = ¢([a, b)) = $((a, b)) = (a, b)) = b— a, 
but define 
$((0, b)) = $((0, b]) = 1+ 6 


if 0 <b<1. Show that this gives an additive set function ¢ on &, which is not 
regular and which cannot be extended to a countably additive set function on a 
o-ring. 
Suppose {n,} is an increasing sequence of positive integers and E is the set of all 
x €(—7, 7) at which {sin 1.x} converges. Prove that m(E)=0. Hint: For every 
ACE, 


i sin 4x dx +0, 
and 
2 (. Giningx)? dx = (3 (1 — cos 2m,x) dx —> m(A) ask-—-> x. 


Suppose E < (—7, 7), m(E) > 0,5 >0. Use the Bessel inequality to prove that 
there are at most finitely many integers ” such that sin x > & for all x € E. 
Suppose fe F?(n),g € F(x). Prove that 


Jadu = [isle {lal de 


if and only if there is a constant c such that g(x) = cf(x) almost everywhere. 
(Compare Theorem 11.35.) 


BIBLIOGRAPHY 


ARTIN, E.: ‘““The Gamma Function,” Holt, Rinehart and Winston, Inc., New York, 
1964. 

BOAS, R. P.: “‘A Primer of Real Functions,” Carus Mathematical Monograph No. 13, 
John Wiley & Sons, Inc., New York, 1960. 

BUCK, R. C. (ed.): ‘Studies in Modern Analysis,” Prentice-Hall, Inc., Englewood 
Cliffs, N.J., 1962. 

———: ‘Advanced Calculus,” 2d ed., McGraw-Hill Book Company, New York, 
1965. 

BURKILL, J. C.: ““The Lebesgue Integral,’’ Cambridge University Press, New York, 1951. 

DIEUDONNE, J.: ““Foundations of Modern Analysis,’> Academic Press, Inc., New York, 
1960. 

FLEMING, W. H.: “Functions of Several Variables,’ Addison-Wesley Publishing Com- 
pany, Inc., Reading, Mass., 1965. 

GRAVES, L. M.: “The Theory of Functions of Real Variables,” 2d ed., McGraw-Hill 
Book Company, New York, 1956. 

HALMOS, P. R.: “Measure Theory,” D. Van Nostrand Company, Inc., Princeton, N.J., 
1950. 


336 PRINCIPLES OF MATHEMATICAL ANALYSIS 


——— : ‘‘Finite-dimensional Vector Spaces,’’ 2d ed., D. Van Nostrand Company, Inc., 
Princeton, N.J., 1958. 

HARDY, G. H.: “Pure Mathematics,” 9th ed., Cambridge University Press, New York, 
1947. 

and ROGOSINSKI, W.: ‘Fourier Series,” 2d ed., Cambridge University Press, 
New York, 1950. 

HERSTEIN, I. N.: ““Topics in Algebra,” Blaisdell Publishing Company, New York, 1964. 

HEWITT, E., and STROMBERG, K.: “Real and Abstract Analysis,’ Springer Publishing 
Co., Inc., New York, 1965. 

KELLOGG, O. D.: “‘Foundations of Potential Theory,’ Frederick Ungar Publishing Co.., 
New York, 1940. 

KNOPP, K.: “Theory and Application of Infinite Series,’ Blackie & Son, Ltd., 
Glasgow, 1928. 

LANDAU, E.G. H.: ““Foundations of Analysis,’ Chelsea Publishing Company, New York, 
1951. 

MCSHANE, E. J.: “Integration,” Princeton University Press, Princeton, N.J., 1944. 

NIVEN, I. M.: “Irrational Numbers,’’ Carus Mathematical Monograph No. 11, John 
Wiley & Sons, Inc., New York, 1956. 

ROYDEN, H. L.: “‘Real Analysis,» The Macmillan Company, New York, 1963. 

RUDIN, W.: ‘Real and Complex Analysis,’ 2d ed., McGraw-Hill Book Company, 
New York, 1974. 

SIMMONS, G. F.: ‘““Topology and Modern Analysis,” McGraw-Hill Book Company, 
New York, 1963. 

SINGER, I. M., and THORPE, J. A.: ‘““Lecture Notes on Elementary Topology and Geom- 
etry,’ Scott, Foresman and Company, Glenview, IIl., 1967. 

SMITH, K. T.: “Primer of Modern Analysis,” Bogden and Quigley, Tarrytown-on- 
Hudson, N.Y., 1971. 

SPIVAK, M.: “Calculus on Manifolds,” W. A. Benjamin, Inc., New York, 1965. 

THURSTON, H. A.: ‘“The Number System,” Blackie & Son, Ltd., London-Glasgow, 1956. 


LIST OF SPECIAL SYMBOLS 


The symbols listed below are followed by a brief statement of their meaning and by 
the number of the page on which they are defined. 


C SGemeEeHO .......... eee 3 
€ Gee notbelongito............. 5 
<, > inclusion signs ............ 3 
Cicer iidias.......05°07.~«.«.... 3 
<—e00, =, > inequality signs.... 3 
Sup ‘leasttupper boutid............ 4 
inf greatest lower bound ......... 4 
-——. 8 
poe, =sonomnfinities .......... Tl ee 
Z COMmplex COnjipate ....255....... 14 
Mei(z) vealepart..c............... 14 
Im(2) imaginarypart ......0...:. 14 
FA 14 
> Ss0nimation’Sign........0... 15, 59 
R* euclidean k-space............. 16 
© Wren ..62....... Sewers 16 
my iWer prom@ict .........c0ee. 16 


[x| mopmofivestorx ...suw9.... 16 


{v,}] GOQWONCE. .« . esa eauuacn. ~. 826 
Vo WHEE... .wunraeeree es. oan 27 
(\,.o 4dntiseetionw.....me...... 2) 
jaub) meme. me 31 
ib) “invenalicws. (23... .<ieeree 31 
E’ complaenvor®.........9%! 32 
E’ ‘limit@pomissel E............60. i) 
jee 0) Wy ee 35 
Daa. css cae Wie a+ bah 2 47 
=> ‘CONVERBESMON .20.......... 47, 98 
limisup wppemiimit.............: 56 
limeinf lowerlmit .g.2........ 56 
gcf cCOWMPOsigom................ 86 
f(x+) right-hand limit ........... 94 
S—) lefehametlianit............ 94 
f',f' (x) derivatives ...... 103 12 
UPL), GP FMAM db, LAP LO 
Riemann GUMBia.. 6... 6. 121, 122 


338 PRINCIPLES OF MATHEMATICAL ANALYSIS 


R, R(x) classes of Riemann (Stieltjes) 


integrable functions ....... 121, 122 
€(X) space of continuous 

OTTO «we ent 150 
lhe {| cRRRRRMG Sus oes ces 140, 150, 326 
exp exponential function ........ 179 
Dy, “Dirtehlet kernel. ............ 189 
Ix) gammafanetion ........... 192 
{e,,..., Ce} Stameard’Dasis ....... 205 
L(X), L(X, Y) spaces of linear 

transfOrnmraviOns................ 207 
iw SS eee 210 
D,f partial derivative ........... 215 
Wy SUT... ce eet ad 
6’,G” classes of differentiable 

a ae 219255 
det [A] determinant............. 252 
A Mn 234 


O13. -- +5 Va) 


OX, .. 5A) Pacobian .. cee... 234 


Pree... ere te nT oe 245 
Co  ROOMPICK Sos ss ssc sere 247 
ax; “Odie RACH... TT. 257 
A multiplication symbol ........ 254 
d_ differentiation operator ........ 260 
wy tietorniiot @ . ow... ccscuwuss 262 
& boundary operator............ 269 
vor Gam ........ 07 eee ee 281 
VeP  diveregice.........<n ee 
6 ring of elementary sets ........ 303 
m Lebesgue measure ....... 303, 308 
[al MR 303, 308 
Wi, Mt families of measurable sets 305 
{x|P} set with property P........ 310 
I*,f~ positive (negative) part 

Oy aI nc IS eh - 312 
K, characteristic function ....... 313 


F, Fin), F?, F7(p) Aaeeesiof 
Lebesgue-integrable 
ftNeHONS .......... ee ee 315, 326 


Abel. N.H.. 75. 174 
Absolute convergence. 71 

of integral. 138 
Absolute value. 14 
Addition (see Sum) 
Addition formula. 178 
Additivity. 301 
Affine chain. 268 
Affine mapping. 266 
Affine simplex. 266 
Algebra. 161 

self-adjoint. 165 

uniformly closed, 161 
Algebraic numbers, 43 
Almost everywhere. 317 
Alternating series. 71 
Analytic function. 172 
Anticommutative law. 256 
Arc. 136 
Area element. 283 
Arithmetic means. 80. 199 
Artin. E.. 192. 195 
Associative law. 5, 28. 259 
Axioms. 5 


Baire’s theorem. 46. 82 

Ball. 31 

Base, 45 

Basic form. 257 

Basis. 205 

Bellman. R.. 198 

Bessel inequality, 188, 328 
Beta function. 193 

Binomial series, 201 
Bohr-Mollerup theorem. 193 
Borel-measurable function. 313 


Borel set. 309 

Boundary. 269 

Bounded convergence. 322 
Bounded function. 89 
Bounded sequence. 48 
Bounded set. 32 
Brouwer's theorem. 203 
Buck. R.C.. 195 


Cantor. G.. 21. 30. 186 
Cantor set. 41. 81. 138. 168. 309 
Cardinal number. 25 
Cauchy criterion. 54, 59. 147 
Cauchy sequence, 21. 52. 82. 329 
Cauchy's condensation test. 61 
Cell. 31 
6"-equivalence, 280 
Chain. 268 

affine. 268 

differentiable. 270 
Chain rule. 105. 214 
Change of variables. 132. 252. 262 
Characteristic function, 313 
Circle of convergence. 69 
Closed curve. 136 
Closed form. 275 
Closed set. 32 
Closure. 35 

uniform. 151. 161 
Collection. 27 
Column matrix. 217 
Column vector. 210 
Common refinement, 123 
Commutative law. 5. 28 
Compact metric space. 36 
Compact set. 36 


INDEX 


Comparison test. 60 
Complement. 32 
Complete metric space. 54, 82. 
1S1. 329 
Complete orthonormal set. 331 
Completion. 82 
Complex field. 12. 184 
Complex number. 12 
Complex plane. 17 
Component of a function. 87. 215 
Composition. 86. 105. 127. 207 
Condensation point. 45 
Conjugate. 14 
Connected set. 42 
Constant function. 85 
Continuity. &5 
uniform. 90 
Continuous functions. space of. 
150 
Continuous mapping. 85 
Continuously differentiable curve. 
136 
Continuously differentiable map- 
ping. 219 
Contraction, 220 
Convergence. 47 
absolute. 71 
bounded. 322 
dominated. 321 
of integral. 138 
pointwise, 144 
radius of. 69. 79 
of sequences. 47 
of series. 59 
uniform. 147 
Convex function, 101 
Convex set. 31 


340 INDEX 


Coordinate function. 88 
Coordinates. 16. 205 
Countable additivity. 301 
Countable base. 45 
Countable set. 25 
Cover. 36 
Cunningham. F.. 167 
Curl. 281 
Curve. 136 
closed. 136 
continuously differentiable. 136 
rectifiable. 136 
space-filling. 168 
Cut. 17 


Davis. P.J.. 192 
Decimals. 11 
Dedekind. R.. 21 
Dense subset. 9. 32 
Dependent set. 205 
Derivative. 104 
directional. 218 
of a form. 260 
of higher order. 110 
of an integral. 133. 236. 324 
integration of, 134, 324 
partial. 215 
of power series. 173 
total, 213 
of a transformation, 214 
of a vector-valued function. 112 
Determinant. 232 
of an operator. 234 
product of. 233 
Diagonal process. 30. 157 
Diameter, 52 
Differentiable function, 104. 212 
Differential. 213 , 
Differential equation. 119. 170 
Differential form (sce Form) 
Differentiation (sec Derivative) 
Dimension. 205 
Directional derivative. 218 
Dirichlet’s kernel. 189 
Discontinuities. 94 
Disjoint sets. 27 
Distance. 30 
Distributive law. 6. 20. 28 
Divergence. 281 
Divergence theorem. 253. 272. 
288 
Divergent sequence. 47 
Divergent series. 89 
Domain. 24 
Dominated convergence theorem. 
PSSuG?, 324 
Double sequence. 144 


e. 63 

Eberlein. W. F.. 184 
Elementary set. 303 
Empty set. 3 
Equicontinuity. 156 


Equivalence relation. 25 
Euclidean space. 16. 30 

Euler's constant. 197 

Exact form. 275 

Existence theorem. 170 
Exponential function. 178 
Extended real number system. 11 
Extension. 99 


Family. 27 
Fatou’s theorem. 320 
Fejer’s kernel. 199 
Fejér's theorem. 199 
Field axioms. § 
Fine. N.J.. 100 
Finite set. 25 
Fixed point. 117 
theorems. 117, 203. 220 
Fleming. W.H.. 280 
Flip. 249 
Form. 244 
basic. 257 
of class ¢'.0". 254 
closed. 275 
derivative of. 260 
exact, 275 
product of. 258. 260 
sum of. 256 
Fourier. J. B.. 186 
Fourier coefficients. 186. 187 
Fourier series. 186. 187. 328 
Function. 24 
absolute value. 88 
analytic. 172 
Borel-measurable. 313 
bounded. 89 
characteristic. 313 
component of. 87 
constant, 85 
continuous, 8§ 
from left. 97 
from right. 97 
continuously differentiable. 219 
convex. 10] 
decreasing. 95 
differentiable, 104. 212 
exponential. 178 
harmonic. 297 
increasing. 95 
inverse. 90 
Lebesgue-integrable. 315 
limit. 144 
linear. 206 
logarithmic. 180 
measurable. 310 
monotonic. 9§ 
nowhere differentiable continu- 
ous. 154 
one-to-one. 25 
orthogonal. 187 
periodic. 183 
product of. 85 
rational. 88 
Riemann-integrable. 121 


Function: 
simple. 313 
sum of. 85 
summable. 315 
trigonometric. 182 
uniformly continuous. 90 
uniformly differentiable. 115 
vector-valued. 85 
Fundamental theorem of calculus. 
134. 324 


Gamma function, 192 

Geometric series. 61 

Gradient. 217. 281 

Graph. 99 

Greatest lower bound. 4 

Green’s identities. 297 

Green's theorem. 253. 255, 272. 
282 


Half-open interval. 31 
Harmonic function. 297 
Havin. V.P.. 113 

Heine- Borel theorem. 39 
Helly’s selection theorem. 167 
Herstein. 1. N.. 65 

Hewitt. E.. 21 

Higher-order derivative. 110 
Hilbert space. 332 

Holder's inequality. 139 


i, 13 
identity operator, 232 
Image. 24 


Imaginary part. 14 
Implicit function theorem. 224 
Improper integral. 139 
Increasing index. 257 
Increasing sequence, 55 
Independent set. 205 
Index of a curve. 201 
Infimum. 4 
Infinite series. 59 
Infinite set. 25 
Infinity. 31 
Initial-value problem. 119. 170 
Inner product. 16 
Integrable functions. spaces of. 
315. 326 
Integral: 
countable additivity of, 316 
differentiation of. 133. 236. 324 
Lebesgue. 314 
lower. 121. 122 
Riemann. 121 
Stieltjes. 122 
upper. 121. 122 
Integral test: 139 
Integration: 
of derivative. 134. 324 
by parts. 134. 139. 141 
interior. 43 


Interior point, 32 

Intermediate value. 93. 100. 108 
Intersection, 27 

Interval. 31, 302 

Into, 24 

Inverse function, 90 

Inverse function theorem. 221 
Inverse image. 24 

Inverse of linear operator, 207 
Inverse mapping, 90 

Invertible transformation, 207 
Irrational number, 1, 10. 65 
isolated point. 32 

Isometry. 82. 170 
Isomorphism, 21 


Jacobian, 234 


Kellogg. O. D.. 281 
Kestelman. H.. 167 
Knopp. K.. 21. 63 


Landau. E.G. H.. 21 
Laplacian. 297 
Least upper bound, 4 
property. 4. 18 
Lebesgue, HL... 186 
Lebesgue-integrable function. 315 
Lebesgue integral, 314 
Lebesgue measure. 308 
Lebesgue’s theorem, 155. 167. 
318. 321 
Left-hand limit. 94 
Leibnitz. G. W.. 71 
Length. 136 
L*Hospital’s rule, 109. 113 
Limit. 47, 83. 144 
left-hand. 94 
lower. 56 
pointwise. 144 
right-hand. 94 
subsequential. 51 
upper. 56 
Limit function. 144 
Limit point. 32 
Line, 17 
Line integral. 255 
Linear combination, 204 
Linear function. 206 
Linear mapping. 206 
Linear operator. 207 
Linear transformation, 206 
Local maximum, 107 
Localization theorem. 190 
Locally one-to-one mapping. 223 
Logarithm. 22. 180 
Logarithmic function, 180 
Lower bound, 3 
Lower integral. 121, 122 
Lower limit. 56 


McShane, E. J.. 313 


Mapping. 24 
affine. 266 
continuous. 85 
continuously differentiable, 219 
linear. 206 
open. 100. 223 
primitive, 248 
uniformly continuous, 90 
(See also Function) 
Matrix. 210 
product. 211 
Maximum, 90 
Mean square approximation. 187 
Mean value theorem. 108. 235 
Measurable function. 310 
Measurable set. 305. 310 
Measurable space. 310 
Measure. 308 
outer, 304 
Measure space, 310 
Measure zero. set of, 309. 317 
Mertens, F.. 74 
Metric space. 30 
Minimum. 90 
Mobius band. 298 
Monotone convergence theorem. 
318 
Monotonic function. 95. 302 
Monotonic sequence. 55 
Multiplication (see Product) 


Negative number. 7 
Negative orientation. 267 
Neighborhood. 32 
Newton's method. 118 
Nijenhuis, A.. 223 
Niven. I.. 65. 198 
Nonnegative number. 60 
Norm. 16. 140. 150. 326 

of operator. 208 
Normal derivative. 297 
Normal space, 101 
Normal vector. 284 
Nowhere differentiable function. 

154 

Null space. 228 
Null vector. 16 
Number: 

algebraic, 43 

cardinal, 25 

complex, 12 

decimal. |! 

finite. 12 

irrational. |, 10. 65 

negative. 7 

nonnegative. 60 

positive. 7. 8 

rational, | 

real. 8 


One-to-one correspondence, 25 
Onto. 24 
Open cover. 36 


INDEX 341 


Open mapping. 100. 223 
Open set. 32 
Order. 3. 17 
lexicographic. 22 
Ordered field. 7. 20 
k-tuple. 16 
pair, 12 
sets 3, 18.22 
Oriented simplex. 266 
Origin, 16 
Orthogonal set of functions. 187 
Orthonormal set. 187. 327. 331 
Outer measure. 304 


Parameter domain, 254 
Parameter interval. 136 
Parseval’s theorem. 191. 198. 328. 
331 

Partial derivative. 215 
Partial sum. 59. 186 
Partition, 120 

of unity. 251 
Perfect set. 32 
Periodic function, 183. 190 
tm. 183 
Plane. 17 
Poincare’s lemma, 275. 280 
Pointwise bounded sequence. 155 
Pointwise convergence. 144 
Polynomial. 88 

trigonometric. (85 
Positive orientation, 267 
Power series. 69, 172 
Primes. 197 
Primitive mapping. 248 
Product. 5 

Cauchy, 73 

of complex numbers. 12 

of determinants, 233 

of field elements. 5 

of forms. 258. 260 

of functions, 85 

inner. 16 

of matrices. 211 

of real numbers. 19. 20 

scalar, 16 

of series. 73 

of transformations. 207 
Projection, 228 
Proper subset. 3 


Radius. 31. 32 

of convergence. 69. 79 
Range. 24. 207 
Rank, 228 
Rank theorem, 229 
Ratio test, 66 
Rational function. 88 
Rational number. | 
Real field. 8 
Real line. 17 
Real number. 8 
Real part. 14 


342 INDEX 


Rearrangement, 75 Set, Sum, 
Rectifiable curve, 136 dense. 9. 32 of linear transformations. 207 
Refinement, 123 elementary. 303 of oriented simplexes. 268 
Reflexive property. 25 empty. 3 of real numbers, 18 
Regular set function, 303 finite, 25 of series. 59 
Relatively open set, 35 independent. 205 of vectors. 16 
Remainder. 211, 244 infinite. 25 Summation by parts. 70 
Restriction, 99 measurable, 305. 310 Support. 246 
Riemann. B., 76, 186 | nonempty. 3 Supremum. 4 
Riemann integral, 121 open, 32 Supremum norm. 150 
Riemann-Stieltjes integral, 122 ordered. 3 Surface. 254 
Riesz-Fischer theorem: 330 perfect. 32. 41 Symmetric difference. 305 
Right-hand limit. 94 relatively open, 35 
Ring, 301 uncountable, 25, 30, 41 
Robison, G. B., 184 Set function, 301 Tangent plane. 284 
Root, 10 o-ring, 301 Tangent vector. 286 
Root test, 65 Simple discontinuity, 94 Tangential component. 286 
Row matrix, 217 Simple function. 313 Taylor polynomial. 244 
Simplex. 247 Taylor's theorem. 110. 116. 176. 243 
; affine. 266 Thorpe. J. A.. 280 
Saddle point, 240 differentiable, 269 Thurston. H.A.. 21 
Scalar product. 16 oriented. 266 Torus, 239-240. 285 
Schoenberg. I. J.. 168 Singer. I. M.. 280 Total derivative. 213 
Schwarz inequality. 15. 139. 326 Solid angle, 294 Transformation (see Function: 
Segment. 31 Space: Mapping) 
Self-adjoint algebra. 165 compact metric, 36 Transitivity. 25 
Separable space, 45 complete metric. 54 Triangle inequality. 14, 16. 30. 140 
Separated sets, 42 connected, 42 Trigonometric functions. 182 
Separation of points, 162 : of continuous functions, 150 Trigonometric polynomial. 185 
Sequence, 26 euclidean. 16 Trigonometric series. 186 
bounded. 48 Hilbert. 332 
Cauchy, 52, 82. 329 of integrable functions, 315, 326 
convergent, 47 measurable, 310 Uncountable set. 25, 30. 41 
divergent, 47 measure, 310 Uniform boundedness. 155 
double, 144 metric, 30 Uniform closure. 151 
of functions. 143 normal. 101 Uniform continuity, 90 
increasing. 55 separable. 45 Uniform convergence. 147 
monotonic, 55 Span. 204 Uniformly closed algebra. i161 
pointwise bounded, 155 Sphere. 272, 277. 294 Uniformly continuous mapping. 90 
pointwise convergent. 144 Spivak. M.. 272. 280 Union, 27 
uniformly bounded, 155 Square root, 2, 81, 118 Uniqueness theorem. 119. 258 
uniformly convergent, 157 Standard basis. 205 Unit cube, 247 
Series, 59 Standard presentation, 257 Unit vector. 217 
absolutely convergent. 71 Standard simplex, 266 Upper bound. 3 
alternating. 71 Stark, E. L.. 199 Upper integral, 121. 122 
convergent, 59 Step function, 129 Upper limit. 56 
divergent, 59 Stieltjes integral, 122 
geometric. 61 Stirling's formula. 194, 200 
nonabsolutely convergent. 72 Stokes’ theorem. 253. 272. 287 Value. 24 
power. 69, 172 Stone- Weierstrass theorem. 162. Variable of integration. 122 
product of, 73 190. 246 Vector. 16 
trigonometric, 186 Stromberg. K . 21 Vector field. 281 
uniformly convergent, 157 Subadditivity, 304 Vector space. 16. 204 
Set, 3 Subcover, 36 Vector-valued function. 85 
at most countable, 25 Subfield. 8. 13 derivative of. 112 
Borel. 309 | Subsequence. 51 Volume. 255. 282 
bounded, 32 Subsequential limit, 51 
bounded above. 3 Subset. 3 
Cantor, 41, 81, 138, 168, 309 dense, 9. 32 Weierstrass test. 148 
closed, 32 proper, 3 Weierstrass theorem, 40, 159 
compact, 36 Sum, 5 Winding number. 201 
complete orthonormal, 331 of complex numbers, 12 
connected, 42 of field elements, 5 
convex, 31 of forms, 256 Zero set, 98, 117 


countable, 25 of functions, 85 Zeta function, 141 


: arty € 


OTHER McGRAW-HILL 
INTERNATIONAL EDITIONS 
IN RELATED FIELDS 


Ahlfors: COMPLEX ANALYSIS, 3/e 
Bender: ADVANCED MATHEMATICAL METHODS FOR 
SCIENTISTS AND ENGINEERS 
Chase: ELEMENTARY STATISTICAL PROCEDURES, 2/e 
Churchill: FOURIER SERIES AND BOUNDARY VALUE PROBLEMS, 3/e 
Churchill: COMPLEX VARIABLES AND APPLICATIONS, 4/e 
Dixon: INTRODUCTION TO STATISTICAL ANALYSIS, 4/e 
Grant: STATISTICAL QUALITY CONTROL, 5/e 
Martin: ORDINARY DIFFERENTIAL EQUATIONS 
Mood-Graybill: INTRODUCTION TO THE THEORY OF STATISTICS, 3/e 
Morrison: MULTIVARIATE STATISTICAL METHODS, 2/e 
Papoulis: PROBABILITY, RANDOM VARIABLES AND . 
STOCHASTIC PROCESSES, 2/e 
Parzynski: INTRODUCTION TO MATHEMATICAL ANALYSIS 
Pipes: APPLIED MATHEMATICS FOR ENGINEERS AND PHYSICISTS, 3/e 
Ralston-Rabinowitz: A FIRST COURSE IN NUMERICAL ANALYSIS, 2/e 
Simmons: INTRODUCTION TO TOPOLOGY AND MODERN ANALYSIS 
Stein: CALCULUS AND ANALYTIC GEOMETRY, 3/e 
Woodroofe: PROBABILITY WITH APPLICATIONS 
Wylie: ADVANCED ENGINEERING MATHEMATICS, 5/e 
Wylie: DIFFERENTIAL EQUATIONS 


ISBN 0-07-085613-3 


Il 


80070"856 


